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SPECIFICATION 
Related Applications 

5 

[0001] This application claims the benefit of priority to Provisional Application No. 

60/394,665 filed July 10, 2002, and is a continuation-in-part of Patent Application No. 
09/922,319, filed March 24, 2000, which is a continuation of U.S. Patent Application No. 
09/382,402, filed August 24, 1999, now U.S. Patent No. 6,295,599, which claims the benefit of 

10 priority to Provisional Application No. 60/097,635 filed on August 24, 1998, and which is a 
continuation-in-part of U.S. Patent Application No. 09/169,963, filed October 13, 1998, now 
U.S. Patent No. 6,006,318, which is a continuation of U.S. Patent Application No. 08/754,827, 
filed November 22, 1996 now U.S. Patent No. 5,822,603, which is a divisional of U.S. Patent 
Application No. 08/516,036, filed August 16, 1995 now U.S. Patent No. 5,742,840, each of the 

1 5 above applications and/or patents are herein incorporated by reference in their entirety. 

Field of the Invention 

[0002] The present invention relates to general purpose processor architectures, and 

20 particularly relates to wide operand architectures. 

REFERENCE TO A "SEQUENCE LISTING." A TABLE. OR A COMPUTER 
PROGRAM LISTING APPENDIX SUBMITTED ON A COMPACT DISK 
[00031 This application includes an appendix, submitted herewith in duplicate on 

25 compact disks labeled as "Copy 1" and "Copy 2." The contents of the compact disks are hereby 
incorporated by reference in their entirety. 

BACKGROUND OF THE INVENTION 



30 



[0004] Communications products require increased computational performance to 

process digital signals in software on a real time basis. Increases in performance have come 
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through improvements in process technology and by improvements in microprocessor design. 
Increased parallelism, higher clock rates, increased densities, coupled with improved design tools 
and compilers have made this more practical. However, many of these improvements cost 
additional overhead in memory and latency due to a lack of the necessary bandwidth that is 

5 closely coupled to the computational units. 

[0005] The performance level of a processor, and particularly a general purpose 

processor, can be estimated from the multiple of a plurality of interdependent factors: clock rate, 

gates per clock, number of operands, operand and data path width, and operand 
and data path partitioning. Clock rate is largely influenced by the choice of circuit and logic 

10 technology, but is also influenced by the number of gates per clock. Gates per clock is how 
many gates in a pipeline may change state in a single clock cycle. This can be reduced by 
inserting latches into the data path: when the number of gates between latches is reduced, a 
higher clock is possible. However, the additional latches produce a longer pipeline length, and 
thus come at a cost of increased instruction latency. The number of operands is straightforward; 

1 5 for example, by adding with carry-save techniques, three values may be added together with little 
more delay than is required for adding two values. Operand and data path width defines how 
much data can be processed at once; wider data paths can perform more complex functions, but 
generally this comes at a higher implementation cost. Operand and data path partitioning refers 
to the efficient use of the data path as width is increased, with the objective of maintaining 

20 substantially peak usage. 

[0006] The last factor, operand and data path partitioning, is treated extensively in 

commonly-assigned U.S. Patent No.'s 5,742,840, 5,794,060, 5,794,061, 5,809,321, and 
5,822,603, herein incorporated by reference in their entirety, which describe systems and 
methods for enhancing the utilization of a general purpose processor by adding classes of 

25 instructions. These classes of instructions use the contents of general purpose registers as data 
path sources, partition the operands into symbols of a specified size, perform operations in 
parallel, catenate the results and place the catenated results into a general-purpose register. 
These patents, all of which are assigned to the same assignee as the present invention, teach a 
general purpose microprocessor which has been optimized for processing and transmitting media 

30 data streams through significant parallelism. 
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[0007] While the foregoing patents offered significant improvements in utilization and 

performance of a general purpose microprocessor, particularly for handling broadband 
communications such as media data streams, other improvements are possible. 
[0008] Many general purpose processors have general registers to store operands for 

5 instructions, with the register width matched to the size of the data path. Processor designs 

generally limit the number of accessible registers per instruction because the hardware to access 
these registers is relatively expensive in power and area. While the number of accessible 
registers varies among processor designs, it is often limited to two, three or four registers per 
instruction when such instructions are designed to operate in a single processor clock cycle or a 
10 single pipeline flow. Some processors, such as the Motorola 68000 have instructions to save and 
restore an unlimited number of registers, but require multiple cycles to perform such an 
instruction. 

[0009] The Motorola 68000 also attempts to overcome a narrow data path combined with 

a narrow register file by taking multiple cycles or pipeline flows to perform an instruction, and 
1 5 thus emulating a wider data path. However, such multiple precision techniques offer only 

marginal improvement in view of the additional clock cycles required. The width and accessible 
number of the general purpose registers thus fundamentally limits the amount of processing that 
can be performed by a single instruction in a register-based machine. 

[0010] Existing processors may provide instructions that accept operands for which one 

20 or more operands are read from a general purpose processor's memory system. However, as 
these memory operands are generally specified by register operands, and the memory system 
data path is no wider than the processor data path, the width and accessible number of general 
purpose operands per instruction per cycle or pipeline flow is not enhanced. 
[001 1] The number of general purpose register operands accessible per instruction is 

25 generally limited by logical complexity and instruction size. For example, it might be possible to 
implement certain desirable but complex functions by specifying a large number of general 
purpose registers, but substantial additional logic would have to be added to a conventional 
design to permit simultaneous reading and bypassing of the register values. While dedicated 
registers have been used in some prior art designs to increase the number or size of source 
30 operands or results, explicit instructions load or store values into these dedicated registers, and 
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additional instructions are required to save and restore these registers upon a change of processor 
context. 

[0012] The size of an execution unit result may be constrained to that of a general 

register so that no dedicated or other special storage is required for the result. Specifying a large 
5 number of general purpose registers as a result would similarly require substantial additional 
logic to be added to a conventional design to permit simultaneous writing and bypassing of the 
register values. 

[0013] When the size of an execution unit result is constrained, it can limit the amount of 

computation which can reasonably be handled by a single instruction. As a consequence, 

10 algorithms must be implemented in a series of single instruction steps in which all intermediate 
results can be represented within the constraints. By eliminating this constraint, instruction sets 
can be developed in which a larger component of an algorithm is implemented as a single 
instruction, and the representation of intermediate results are no longer limited in size. Further, 
some of these intermediate results are not required to be retained upon completion of the larger 

1 5 component of an algorithm, so a processor freed of these constraints can improve performance 
and reduce operating power by not storing and retrieving these results from the general register 
file. When the intermediate results are not retained in the general register file, processor 
instruction sets and implemented algorithms are also not constrained by the size of the general 
register file. 

20 [0014] There has therefore been a need for a processor system capable of efficient 

handling of operands and results of greater width than either the memory system or any 
accessible general purpose register. There is also a need for a processor system capable of 
efficient handling of operands and results of greater overall size than the entire general register 
file. 

25 

SUMMARY OF THE INVENTION 

[0015] Commonly-assigned and related U.S. Patent No. 6,295,599, describes in detail a 

method and system for improving the performance of general-purpose processors by expanding 
30 at least one source operand to a width greater than the width of either the general purpose 
register or the data path width. Further improvements in performance may be achieved by 
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allowing a plurality of source operands to be expanded to a greater width than either the memory 
system or any accessible general purpose register, and by allowing the at least one result operand 
to be expanded to a greater width than either the memory system or any accessible general 
purpose register. 

5 [00 1 6] The present invention provides a system and method for improving the 

performance of general purpose processors by expanding at least one source operand or at least 
one result operand to a width greater than the width of either the general purpose register or the 
data path width. In addition, several classes of instructions will be provided which cannot be 
performed efficiently if the source operands or the at least one result operand are limited to the 

10 width and accessible number of general purpose registers. 

[0017] In the present invention, source and result operands are provided which are 

substantially larger than the data path width of the processor. This is achieved, in part, by using 
a general purpose register to specify at least one memory address from which at least more than 
one, but typically several data path widths of data can be read. To permit such a wide operand to 

15 be performed in a single cycle, a data path functional unit is augmented with dedicated storage to 
which the memory operand is copied on an initial execution of the instruction. Further execution 
of the instruction or other similar instructions that specify the same memory address can read the 
dedicated storage to obtain the operand value. However, such reads are subject to conditions to 
verify that the memory operand has not been altered by intervening instructions. If the memory 

20 operand remains current - that is, the conditions are met - the memory operand fetch can be 

combined with one or more register operands in the functional unit, producing a result. The size 
of the result may be constrained to that of a general register so that no dedicated or other special 
storage is required for the result. The size of the result for additional instructions may not be so 
constrained, and so utilize dedicated storage to which the result operand is placed on execution 

25 of the instruction. The dedicated storage may be implemented in a local memory tightly coupled 
to the logic circuits that comprise the functional unit. 

[0018] The present invention extends the previous embodiments to include methods and 

apparatus for performing operations that both receive operands from wide embedded memories 
and also deposit results in wide embedded memories. The present invention includes operations 
30 that autonomously read and update the wide embedded memories in multiple successive cycles 
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of access and computation. The present invention also describes operations that employ 
simultaneously two or more independently addressed wide embedded memories. 
[0019] Exemplary instructions using wide operations include wide instructions that 

perform bit level switching (Wide Switch), byte or larger table-lookup (Wide Translate), Wide 
5 Multiply Matrix, Wide Multiply Matrix Extract, Wide Multiply Matrix Extract Immediate, Wide 
Multiply Matrix Floating point, and Wide Multiply Matrix Galois. 

[0020] Additional exemplary instructions using wide operations include wide instructions 

that solve equations iteratively (Wide Solve Galois), perform fast transforms (Wide Transform 
Slice), compute digital filter or motion estimation (Wide Convolve Extract, Wide Convolve 
10 Floating-point), decode Viterbi or turbo codes (Wide Decode), general look-up tables and 
interconnection (Wide Boolean). 

[0021] Another aspect of the present invention addresses efficient usage of a multiplier 

array that is fully used for high precision arithmetic, but is only partly used for other, lower 
precision operations. This can be accomplished by extracting the high-order portion of the 

15 multiplier product or sum of products, adjusted by a dynamic shift amount from a general 

register or an adjustment specified as part of the instruction, and rounded by a control value from 
a register or instruction portion. The rounding may be any of several types, including round-to- 
nearest/even, toward zero, floor, or ceiling. Overflows are typically handled by limiting the 
result to the largest and smallest values that can be accurately represented in the output result. 

20 [0022] When an extract is controlled by a register, the size of the result can be specified, 

allowing rounding and limiting to a smaller number of bits than can fit in the result. This permits 
the result to be scaled for use in subsequent operations without concern of overflow or rounding. 
As a result, performance is enhanced. In those instances where the extract is controlled by a 
register, a single register value defines the size of the operands, the shift amount and size of the 

25 result, and the rounding control. By placing such control information in a single register, the size 
of the instruction is reduced over the number of bits that such an instruction would otherwise 
require, again improving performance and enhancing processor flexibility. Exemplary 
instructions are Ensemble Convolve Extract, Ensemble Multiply Extract, Ensemble Multiply 
Add Extract, and Ensemble Scale Add Extract. With particular regard to the Ensemble Scale 

30 Add Extract Instruction, the extract control information is combined in a register with two values 
used as scalar multipliers to the contents of two vector multiplicands. This combination reduces 
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the number of registers otherwise required, thus reducing the number of bits required for the 
instruction. 

[0023] A method of performing a computation in a programmable processor, the 

programmable processor having a first memory system having a first data path width, and a 
5 second memory system and a third memory system each of the second memory system and the 
third memory system having a data path width which is greater than the first data path width, 
may comprise the steps of: copying a first memory operand portion from the first memory 
system to the second memory system, the first memory operand portion having the first data path 
width; copying a second memory operand portion from the first memory system to the second 

10 memory system, the second memory operand portion having the first data path width and being 
catenated in the second memory system with the first memory operand portion, thereby forming 
first catenated data; copying a third memory operand portion from the first memory system to the 
third memory system, the third memory operand portion having the first data path width; 
copying a fourth memory operand portion from the first memory system to the third memory 

1 5 system, the fourth memory operand portion having the first data path width and being catenated 
in the third memory system with the third memory operand portion, thereby forming second 
catenated data; and performing a computation of a single instruction using the first catenated data 
and the second catenated data. 

[0024] In the method of performing a computation in a programmable processor, the step 

20 of performing a computation may further comprise reading a portion of the first catenated data 
and a portion of the second catenated data each of which is greater in width than the first data 
path width and using the portion of the first catenated data and the portion of the second 
catenated data to perform the computation. 

[0025] The method of performing a computation in a programmable processor may 

25 further comprise the step of specifying a memory address of each of the first catenated data and 
of the second catenated data within the first memory system. 

[0026] The method of performing a computation in a programmable processor may 

further comprise the step of specifying a memory operand size and a memory operand shape of 
each of the first catenated data and the second catenated data. 
30 [0027] The method of performing a computation in a programmable processor may 

further comprise the step of checking the validity of each of the first catenated data in the second 
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memory system and the second catenated data in the third memory system, and, if valid, 
permitting a subsequent instruction to use the first and second catenated data without copying 
from the first memory system. 

[0028] The method of performing a computation in a programmable processor may 

5 further comprise performing a transform of partitioned elements contained in the first catenated 
data using coefficients contained in the second catenated data, thereby forming a transform data, 
extracting a specified subfield of the transform data, thereby forming an extracted data and 
catenating the extracted data. 

[0029] An alternative method of performing a computation in a programmable processor, 

10 the programmable processor having a first memory system having a first data path width, and a 
second and a third memory system having a data path width which is greater than the first data 
path width, may comprising the steps of: copying a first memory operand portion from the first 
memory system to the second memory system, the first memory operand portion having the first 
data path width; copying a second memory operand portion from the first memory system to the 

15 second memory system, the second memory operand portion having the first data path width and 
being catenated in the second memory system with the first memory operand portion, thereby 
forming first catenated data; performing a computation of a single instruction using the first 
catenated data and producing a second catenated data; copying a third memory operand portion 
from the third memory system to the first memory system, the third memory operand portion 

20 having the first data path width and containing a portion of the second catenated data; and 
copying a fourth memory operand portion from the third memory system to the first memory 
system, the fourth memory operand portion having the first data path width and containing a 
portion of the second catenated data, wherein the fourth memory operand portion is catenated in 
the third memory system with the third memory operand portion. 

25 [0030] In the alternative method of performing a computation in a programmable 

processor the step of performing a computation may further comprise the step of reading a 
portion of the first catenated data which is greater in width than the first data path width and 
using the portion of the first catenated data to perform the computation. 

[003 1 ] The alternative method of performing a computation in a programmable processor 

30 may further comprise the step of specifying a memory address of each of the first catenated data 
and of the second catenated data within the first memory system. 
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[0032] The alternative method of performing a computation in a programmable processor 

may further comprise the step of specifying a memory operand size and a memory operand shape 
of each of the first catenated data and the second catenated data. 

[0033] The alternative method of performing a computation in a programmable processor 

5 may further comprise the step of checking the validity of each of the first catenated data in the 
second memory system and the second catenated data in the third memory system, and, if valid, 
permitting a subsequent instruction to use the first catenated data without copying from the first 
memory system. 

[0034] In the alternative method of performing a computation, the step of performing a 

10 computation may further comprise the step of performing a transform of partitioned elements 
contained in the first catenated data, thereby forming a transform data, extracting a specified 
subfield of the transform data, thereby forming an extracted data and catenating the extracted 
data, forming the second catenated data. 

[0035] In the alternative method of performing a computation, the step of performing a 

1 5 computation may further comprise the step of combining using Boolean arithmetic a portion of 
the extracted data with an accumulated Boolean data, combining partitioned elements of the 
accumulated Boolean data using Boolean arithmetic, forming combined Boolean data, 
determining the most significant bit of the extracted data from the combined Boolean data, and 
returning a result comprising the position of the most significant bit to a register. 

20 [0036] The alternative method of performing a computation in a programmable processor 

may further comprise manipulating a first and a second validity information corresponding to 
first and second catenated data, wherein after completion of an instruction specifying a memory 
address of first catenated data, the contents of second catenated data are provided to the first 
memory system in place of first catenated data. 

25 [0037] A programmable processor according to the present invention may comprise: a 

first memory system having a first data path width; a second memory system and a third memory 
system, wherein each of the second memory system and the third memory system have a data 
path width which is greater than the first data path width; a first copying module configured to 
copy a first memory operand portion from the first memory system to the second memory 

30 system, the first memory operand portion having the first data path width, and configured to 
copy a second memory operand portion from the first memory system to the second memory 

10 
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system, the second memory operand portion having the first data path width and being catenated 
in the second memory system with the first memory operand portion, thereby forming first 
catenated data; a second copying module configured to copy a third memory operand portion 
from the first memory system to the third memory system, the third memory operand portion 
5 having the first data path width, and configured to copy a fourth memory operand portion from 
the first memory system to the third memory system, the fourth memory operand portion having 
the first data path width and being catenated in the third memory system with the third memory 
operand portion, thereby forming second catenated data; and a functional unit configured to 
perform computations using the first catenated data and the second catenated data. 
1 0 [0038] In the programmable processor, the functional unit may be further configured to 

read a portion of each of the first catenated data and the second catenated data which is greater in 
width than the first data path width and use the portion of each of the first catenated data and the 
second catenated data to perform the computation. 

[0039] In the programmable processor, the functional unit may be further configured to 

15 specify a memory address of each of the first catenated data and of the second catenated data 
within the first memory system. 

[0040] In the programmable processor, the functional unit may be further configured to 

specify a memory operand size and a memory operand shape of each of the first catenated data 
and the second catenated data. 
20 [0041 ] The programmable processor may further comprise a control unit configured to 

check the validity of each of the first catenated data in the second memory system and the second 
catenated data in the third memory system, and, if valid, permitting a subsequent instruction to 
use each of the first catenated data and the second catenated data without copying from the first 
memory system. 

25 [0042] In the programmable processor, the functional unit may'be further configured to 

convolve partitioned elements contained in the first catenated data with partitioned elements 
contained in the second catenated data, forming a convolution data, extract a specified subfield 
of the convolution data and catenate extracted data, forming a catenated result having a size 
equal to that of the functional unit data path width. 

30 [0043] In the programmable processor, the functional unit may be further configured to 

perform a transform of partitioned elements contained in the first catenated data using 

11 
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coefficients contained in the second catenated data, thereby forming a transform data, extract a 
specified subfield of the transform data, thereby forming an extracted data and catenate the 
extracted data. 

[0044] An alternative programmable processor according to the present invention may 

5 comprise: a first memory system having a first data path width; a second memory system and a 
third memory system each of the second memory system and the third memory system having a 
data path width which is greater than the first data path width; a first copying module configured 
to copy a first memory operand portion from the first memory system to the second memory 
system, the first memory operand portion having the first data path width, and configured to 

10 copy a second memory operand portion from the first memory system to the second memory 

system, the second memory operand portion having the first data path width and being catenated 
in the second memory system with the first memory operand portion, thereby forming first 
catenated data; a second copying module configured to copy a third memory operand portion 
from the third memory system to the first memory system, the third memory operand portion 

15 having the first data path width and containing a portion of a second catenated data, and copy a 
fourth memory operand portion from the third memory system to the first memory system, the 
fourth memory operand portion having the first data path width and containing a portion of the 
second catenated data, wherein the fourth memory operand portion is catenated in the third 
memory system with the third memory operand portion; and a functional unit configured to 

20 perform computations using the first catenated data and the second catenated data. 

[0045] In the alternative programmable processor the functional unit may be further 

configured to read a portion of the first catenated data which is greater in width than the first data 
path width and use the portion of the first catenated data to perform the computation. 
[0046] In the alternative programmable processor the functional unit may be further 

25 configured to specify a memory address of each of the first catenated data and of the second 
catenated data within the first memory system. 

[0047] In the alternative programmable processor the functional unit may be further 

configured to specify a memory operand size and a memory operand shape of each of the first 
catenated data and the second catenated data. 
30 [0048] The alternative programmable processor may further comprise a control unit 

configured to check the validity of the first catenated data in the second memory system, and, if 
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valid, permitting a subsequent instruction to use the first catenated data without copying from the 
first memory system. 

[0049] In the alternative programmable processor the functional unit may be further 

configured to transform partitioned elements contained in the first catenated data, thereby 
forming a transform data, extract a specified subfield of the transform data, thereby forming an 
extracted data and catenate the extracted data, forming the second catenated data. 
[0050] In the alternative programmable processor the functional unit may be further 

configured to combine using Boolean arithmetic a portion of the extracted data with an 
accumulated Boolean data, combine partitioned elements of the accumulated Boolean data using 
Boolean arithmetic, forming combined Boolean data, determine the most significant bit of the 
extracted data from the combined Boolean data, and provide a result comprising the position of 
the most significant bit. 

[005 1 ] The alternative programmable processor may further comprise a control unit 

configured to manipulate a first and a second validity information corresponding to first and 
second catenated data, wherein after completion of an instruction specifying a memory address 
of first catenated data, the contents of second catenated data are provided to the first memory 
system in place of first catenated data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0052] Figure 1 is a system level diagram showing the functional blocks of a system in 

accordance with an exemplary embodiment of the present invention. 

[0053] Figure 2 is a matrix representation of a wide matrix multiply in accordance with 

an exemplary embodiment of the present invention. 

[0054] Figure 3 is a further representation of a wide matrix multiple in accordance with 

an exemplary embodiment of the present invention. 

[0055] Figure 4 is a system level diagram showing the functional blocks of a system 

incorporating a combined Simultaneous Multi Threading and Decoupled Access from Execution 
processor in accordance with an exemplary embodiment of the present invention. 
[0056] Figure 5 illustrates a wide operand in accordance with an exemplary embodiment 

of the present invention. 
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[0057] Figure 6 illustrates an approach to specifier decoding in accordance with an 

exemplary embodiment of the present invention. 

[0058] Figure 7 illustrates in operational block form a Wide Function Unit in accordance 

with an exemplary embodiment of the present invention. 
5 [0059] Figure 8 illustrates in flow diagram form the Wide Microcache control function in 

accordance with an exemplary embodiment of the present invention. 
[0060] Figure 9 illustrates Wide Microcache data structures in accordance with an 

exemplary embodiment of the present invention. 

[0061] Figures 10 and 1 1 illustrate a Wide Microcache control in accordance with an 

1 0 exemplary embodiment of the present invention. 

[0062] Figures 12A-12D illustrate a Wide Switch instruction in accordance with an 

exemplary embodiment of the present invention. 

[0063] Figures 13A-13D illustrate a Wide Translate instruction in accordance with an 

exemplary embodiment of the present invention. 
15 [0064] Figures 14A - 14E illustrate a Wide Multiply Matrix instruction in accordance 

with an exemplary embodiment of the present invention. 

[0065] Figures 15 A - 15F illustrate a Wide Multiply Matrix Extract instruction in 

accordance with an exemplary embodiment of the present invention. 

[0066] Figures 16A - 16E illustrate a Wide Multiply Matrix Extract Immediate 

20 instruction in accordance with an exemplary embodiment of the present invention. 

[0067] Figures 17A - 17E illustrate a Wide Multiply Matrix Floating point instruction in 

accordance with an exemplary embodiment of the present invention. 

[0068] Figures 18A - 18D illustrate a Wide Multiply Matrix Galois instruction in 

accordance with an exemplary embodiment of the present invention. 
25 [0069] Figures 19A - 19G illustrate an Ensemble Extract Inplace instruction in 

accordance with an exemplary embodiment of the present invention. 

[0070] Figures 20A - 20J illustrate an Ensemble Extract instruction in accordance with an 

exemplary embodiment of the present invention. 

[0071] Figures 21 A - 2 IB illustrate a System and Privileged Library Calls in accordance 

30 with an exemplary embodiment of the present invention. 
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[0072] Figures 22A - 22B illustrate an Ensemble Scale- Add Floating-point instruction in 

accordance with an exemplary embodiment of the present invention. 

[0073] Figures 23A - 23C illustrate a Group Boolean instruction in accordance with an 

exemplary embodiment of the present invention. 
5 [0074] Figures 24A - 24C illustrate a Branch Hint instruction in accordance with an 

exemplary embodiment of the present invention. 

[0075] Figures 25 A - 25C illustrate an Ensemble Sink Floating-point instruction in 

accordance with an exemplary embodiment of the present invention. 

[0076] Figures 26A - 26C illustrate Group Add instructions in accordance with an 

1 0 exemplary embodiment of the present invention. 

[0077] Figures 27A - 27C illustrate Group Set instructions and Group Subtract 

instructions in accordance with an exemplary embodiment of the present invention. 

[0078] Figures 28A - 28C illustrate Ensemble Convolve, Ensemble Divide, Ensemble 

Multiply, and Ensemble Multiply Sum instructions in accordance with an exemplary 
1 5 embodiment of the present invention. 

[0079] Figure 29 illustrates exemplary functions that are defined for use within the 

detailed instruction definitions in other sections. 

[0080] Figures 30A - 30C illustrate Ensemble Floating-Point Add, Ensemble Floating- 

Point Divide, and Ensemble Floating-Point Multiply instructions in accordance with an 

20 exemplary embodiment of the present invention. 

[0081] Figures 31 A - 31C illustrate Ensemble Floating-Point Subtract instructions in 

accordance with an exemplary embodiment of the present invention. 
[0082] Figures 32A - 32D illustrate Crossbar Compress, Expand, Rotate, and Shift 

instructions in accordance with an exemplary embodiment of the present invention. 

25 [0083] Figures 33A - 33D illustrate Extract instructions in accordance with an exemplary 

embodiment of the present invention. 

[0084] Figures 34A - 34E illustrate Shuffle instructions in accordance with an exemplary 

embodiment of the present invention. 

[0085] Figures 35A - 35B illustrate Wide Solve Galois instructions in accordance with 

30 an exemplary embodiment of the present invention. 
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[0086] Figures 36A - 36B illustrate Wide Transform Slice instructions in accordance 

with an exemplary embodiment of the present invention. 

[0087] Figures 37 A - 37K illustrate Wide Convolve Extract instructions in accordance 

with an exemplary embodiment of the present invention. 
5 [0088] Figure 38 illustrates Transfers Between Wide Operand Memories in accordance 

with an exemplary embodiment of the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 
[0089] Processor Layout 

10 [0090] Referring first to Figure 1, a general purpose processor is illustrated therein in 

block diagram form. In Figure 1, four copies of an access unit are shown, each with an access 
instruction fetch queue A-Queue 101-104. Each access instruction fetch queue A-Queue 
101-104 is coupled to an access register file AR 105-108, which are each coupled to two access 
functional units A 109-1 16. In a typical embodiment, each thread of the processor may have on 

15 the order of sixty-four general purpose registers (e.g., the AR's 105-108 and ER's 125-128). The 
access units function independently for four simultaneous threads of execution, and each 
compute program control flow by performing arithmetic and branch instructions and access 
memory by performing load and store instructions. These access units also provide wide 
operand specifiers for wide operand instructions. These eight access functional units A 109-1 16 

20 produce results for access register files AR 105-108 and memory addresses to a shared memory 
system 117-120. 

[009 1 ] In one embodiment, the memory hierarchy includes on-chip instruction and data 

memories, instruction and data caches, a virtual memory facility, and interfaces to external devices. In 
Fig, 1, the memory system is comprised of a combined cache and niche memory 1 17, an external 

25 bus interface 118, and, externally to the device, a secondary cache 1 19 and main memory system 
with I/O devices 120. The memory contents fetched from memory system 1 17-120 are 
combined with execute instructions not performed by the access unit, and entered into the four 
execute instruction queues E-Queue 121-124. For wide instructions, memory contents fetched 
from memory system 1 17-120 are also provided to wide operand microcaches 132-136 by bus 

30 137. Instructions and memory data from E-queue 121-124 are presented to execution register 
files 125-128, which fetch execution register file source operands. The instructions are coupled 
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to the execution unit arbitration unit Arbitration 131, that selects which instructions from the four 
threads are to be routed to the available execution functional units E 141 and 149, X 142 and 
148, G 143-144 and 146-147, and T 145. The execution functional units E 141 and 149, the 
execution functional units X 142 and 148, and the execution functional unit T 145 each contain a 
5 wide operand microcache 132-136, which are each coupled to the memory system 1 17 by bus 
137. 

[0092] The execution functional units G 143-144 and 146-147 are group arithmetic and 

logical units that perform simple arithmetic and logical instructions, including group operations 
wherein the source and result operands represent a group of values of a specified symbol size, 
10 which are partitioned and operated on separately, with results catenated together. In a presently 
preferred embodiment the data path is 128 bits wide, although the present invention is not 
intended to be limited to any specific size of data path. 

[0093] The execution functional units X 142 and 148 are crossbar switch units that 

perform crossbar switch instructions. The crossbar switch units 142 and 148 perform data 
1 5 handling operations on the data stream provided over the data path source operand buses 151- 
158, including deals, shuffles, shifts, expands, compresses, swizzles, permutes and reverses, plus 
the wide operations discussed hereinafter. In a key element of a first aspect of the invention, at 
least one such operation will be expanded to a width greater than the general register and data 
path width. 

20 [0094] The execution functional units E 141 and 149 are ensemble units that perform 

ensemble instructions using a large array multiplier, including group or vector multiply and 
matrix multiply of operands partitioned from data path source operand buses 151-158 and treated 
as integer, floating point, polynomial or Galois field values. Matrix multiply instructions and 
other operations utilize a wide operand loaded into the wide operand microcache 132 and 136. 

25 [0095] The execution functional unit T 145 is a translate unit that performs table-look-up 

operations on a group of operands partitioned from a register operand, and catenates the result. 
The Wide Translate instruction utilizes a wide operand loaded into the wide operand microcache 
134. 

[0096] The execution functional units E 141, 149, execution functional units X - 142, 

30 148, and execution functional unit T each contain dedicated storage to permit storage of source 
operands including wide operands as discussed hereinafter. The dedicated storage 132 - 136, 
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which may be thought of as a wide microcache, typically has a width which is a multiple of the 
width of the data path operands related to the data path source operand buses 151-158. Thus, if 
the width of the data path 151 - 158 is 128 bits, the dedicated storage 132 - 136 may have a width 
of 256, 512, 1024 or 2048 bits. Operands which utilize the full width of the dedicated storage 
5 are referred to herein as wide operands, although it is not necessary in all instances that a wide 
operand use the entirety of the width of the dedicated storage; it is sufficient that the wide 
operand use a portion greater than the width of the memory data path of the output of the 
memory system 1 17-120 and the functional unit data path of the input of the execution functional 
units 141-149, though not necessarily greater than the width of the two combined. Because the 

10 width of the dedicated storage 132-136 is greater than the width of the memory operand bus 137, 
portions of wide operands are loaded sequentially into the dedicated storage 132-136. However, 
once loaded, the wide operands may then be used at substantially the same time. It can be seen 
that functional units 141-149 and associated execution registers 125-128 form a data functional 
unit, the exact elements of which may vary with implementation. 

15 [0097] The execution register file ER 125-128 source operands are coupled to the 

execution units 141-145 using source operand buses 151-154 and to the execution units 145-149 
using source operand buses 155-158. The function unit result operands from execution units 
141-145 are coupled to the execution register file ER 125-128 using result bus 161 and the 
function units result operands from execution units 145-149 are coupled to the execution register 

20 file using result bus 1 62. 

[0098] Wide Multiply Matrix 

[0099] The wide operands of the present invention provide the ability to execute complex 

instructions such as the wide multiply matrix instruction shown in Figure 2, which can be 

25 appreciated in an alternative form, as well, from Figure 3. As can be appreciated from Figures 2 
and 3, a wide operand permits, for example, the matrix multiplication of various sizes and shapes 
which exceed the data path width. The example of Figure 2 involves a matrix specified by 
register rc having 128*64/size bits (512 bits for this example) multiplied by a vector contained in 
register rb having 128 bits, to yield a result, placed in register rd, of 128 bits. 

30 [00100] The notation used in Figure 2 and following similar figures illustrates a 

multiplication as a shaded area at the intersection of two operands projected in the horizontal and 
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vertical dimensions. A summing node is illustrated as a line segment connecting a darkened dots 
at the location of multiplier products that are summed. Products that are subtracted at the 
summing node are indicated with a minus symbol within the shaded area. 
[00101] When the instruction operates on floating-point values, the multiplications and 
5 summations illustrated are floating point multiplications and summations. An exemplary 
embodiment may perform these operations without rounding the intermediate results, thus 
computing the final result as if computed to infinite precision and then rounded only once. 
[00102] It can be appreciated that an exemplary embodiment of the multipliers may 
compute the product in carry-save form and may encode the multiplier rb using Booth encoding 

10 to minimize circuit area and delay. It can be appreciated that an exemplary embodiment of such 
summing nodes may perform the summation of the products in any order, with particular 
attention to minimizing computation delay, such as by performing the additions in a binary or 
higher-radix tree, and may use carry-save adders to perform the addition to minimize the 
summation delay. It can also be appreciated that an exemplary embodiment may perform the 

15 summation using sufficient intermediate precision that no fixed-point or floating-point overflows 
occur on intermediate results. 

[00103] A comparison of Figures 2 and 3 can be used to clarify the relation between the 
notation used in Figure 2 and the more conventional schematic notation in Figure 3, as the same 
operation is illustrated in these two figures. 

20 

[00104] Wide Operand 

[00105] The operands that are substantially larger than the data path width of the 
processor are provided by using a general-purpose register to specify a memory specifier from 
which more than one but in some embodiments several data path widths of data can be read into 

25 the dedicated storage. The memory specifier typically includes the memory address together 
with the size and shape of the matrix of data being operated on. The memory specifier or wide 
operand specifier can be better appreciated from Figure 5, in which a specifier 500 is seen to be 
an address, plus a field representative of the size/2 and a further field representative of width/2, 
where size is the product of the depth and width of the data. The address is aligned to a specified 

30 size, for example sixty four bytes, so that a plurality of low order bits (for example, six bits) are 
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zero. The specifier 500 can thus be seen to comprise a first field 505 for the address, plus two 
field indicia 510 within the low order six bits to indicate size and width. 
[001 06] Specifier Decoding 

[00107] The decoding of the specifier 500 may be further appreciated from Figure 6 
5 where, for a given specifier 600 made up of an address field 605 together with a field 610 

comprising plurality of low order bits. By a series of arithmetic operations shown at steps 615 
and 620, the portion of the field 610 representative of width/2 is developed. In a similar series of 
steps shown at 625 and 630, the value of t is decoded, which can then be used to decode both 
size and address. The portion of the field 610 representative of size/2 is decoded as shown at 
10 steps 635 and 640, while the address is decoded in a similar way at steps 645 and 650. 
[00108] Wide Function Unit 

[001 09] The wide function unit may be better appreciated from Figure 7, in which a 
register number 700 is provided to an operand checker 705. Wide operand specifier 710 
communicates with the operand checker 705 and also addresses memory 715 having a defined 

15 memory width. The memory address includes a plurality of register operands 720A n, which are 
accumulated in a dedicated storage portion 714 of a data functional unit 725. In the exemplary 
embodiment shown in Figure 7, the dedicated storage 71.4 can be seen to have a width equal to 
eight data path widths, such that eight wide operand portions 730A-H are sequentially loaded 
into the dedicated storage to form the wide operand. Although eight portions are shown in 

20 Figure 7, the present invention is not limited to eight or any other specific multiple of data path 
widths. Once the wide operand portions 730A-H are sequentially loaded, they may be used as a 
single wide operand 735 by the functional element 740, which may be any element(s) from 
Figure 1 connected thereto. The result of the wide operand is then provided to a result register 
745, which in a presently preferred embodiment is of the same width as the memory width. 

25 [001 10] Once the wide operand is successfully loaded into the dedicated storage 714, a 
second aspect of the present invention may be appreciated. Further execution of this instruction 
or other similar instructions that specify the same memory address can read the dedicated storage 
to obtain the operand value under specific conditions that determine whether the memory 
operand has been altered by intervening instructions. Assuming that these conditions are met, 

30 the memory operand fetch from the dedicated storage is combined with one or more register 

operands in the functional unit, producing a result. In some embodiments, the size of the result is 
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limited to that of a general register, so that no similar dedicated storage is required for the result. 
However, in some different embodiments, the result may be a wide operand, to further enhance 
performance. 

[001 11] To permit the wide operand value to be addressed by subsequent instructions 
5 specifying the same memory address, various conditions must be checked and confirmed: 
[001 12] Those conditions include: 

[001 13] Each memory store instruction checks the memory address against the memory 
addresses recorded for the dedicated storage. Any match causes the storage to be marked 
invalid, since a memory store instruction directed to any of the memory addresses stored in 
1 0 dedicated storage 714 means that data has been overwritten. 

[001 14] The register number used to address the storage is recorded. If no intervening 
instructions have written to the register, and the same register is used on the subsequent 
instruction, the storage is valid (unless marked invalid by rule #1). 

[001 1 5] If the register has been modified or a different register number is used, the value 

15 of the register is read and compared against the address recorded for the dedicated storage. This 
uses more resources than #1 because of the need to fetch the register contents and because the 
width of the register is greater than that of the register number itself. If the address matches, the 
storage is valid. The new register number is recorded for the dedicated storage. 
[001 16] If conditions #2 or #3 are not met, the register contents are used to address the 

20 general-purpose processor's memory and load the dedicated storage. If dedicated storage is 
already fully loaded, a portion of the dedicated storage must be discarded (victimized) to make 
room for the new value. The instruction is then performed using the newly updated dedicated 
storage. The address and register number is recorded for the dedicated storage. 
[001 17] By checking the above conditions, the need for saving and restoring the dedicated 

25 storage is eliminated. In addition, if the context of the processor is changed and the new context 
does not employ Wide instructions that reference the same dedicated storage, when the original 
context is restored, the contents of the dedicated storage are allowed to be used without 
refreshing the value from memory, using checking rule #3. Because the values in the dedicated 
storage are read from memory and not modified directly by performing wide operations, the 

30 values can be discarded at any time without saving the results into general memory. This 
property simplifies the implementation of rule #4 above. 
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[001 18] An alternate embodiment of the present invention can replace rule #1 above with 
the following rule: 

[00 119] la. Each memory store instruction checks the memory address against the 
memory addresses recorded for the dedicated storage. Any match causes the dedicated storage 
5 to be updated, as well as the general memory. 

[001 20] By use of the above rule 1 .a, memory store instructions can modify the dedicated 
storage, updating just the piece of the dedicated storage that has been changed, leaving the 
remainder intact. By continuing to update the general memory, it is still true that the contents of 
the dedicated memory can be discarded at any time without saving the results into general 
10 memory. Thus rule #4 is not made more complicated by this choice. The advantage of this 
alternate embodiment is that the dedicated storage need not be discarded (invalidated) by 
memory store operations. 

[00121] Wide Microcache Data Structures 

15 [00 1 22] Referring next to Figure 9, an exemplary arrangement of the data structures of the 
wide microcache or dedicated storage 1 14 may be better appreciated. The wide microcache 
contents, wmcx, can be seen to form a plurality of data path widths 900A-n, although in the 
example shown the number is eight. The physical address, wmc.pa, is shown as 64 bits in the 
example shown, although the invention is not limited to a specific width. The size of the 

20 contents, wmc.size, is also provided in a field which is shown as 10 bits in an exemplary 

embodiment. A "contents valid" flag, wmc.cv, of one bit is also included in the data structure, 
together with a two bit field for thread last used, or wmc.th. In addition, a six bit field for 
register last used, wmc.reg, is provided in an exemplary embodiment. Further, a one bit flag for 
register and thread valid, or wmc.rtv, may be provided. 

25 

[00123] Wide Microcache Control - Software 

[00124] The process by which the microcache is initially written with a wide operand, and 
thereafter verified as valid for fast subsequent operations, may be better appreciated from 
Figure 8. The process begins at 800, and progresses to step 805 where a check of the register 
30 contents is made against the stored value wmc.rc. If true, a check is made at step 810 to verify 
the thread. If true, the process then advances to step 815 to verify whether the register and thread 
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are valid. If step 815 reports as true, a check is made at step 820 to verify whether the contents 
are valid. If all of steps 805 through 820 return as true, the subsequent instruction is able to 
utilize the existing wide operand as shown at step 825, after which the process ends. However, if 
any of steps 805 through 820 return as false, the process branches to step 830, where content, 
5 physical address and size are set. Because steps 805 through 820 all lead to either step 825 or 
830, steps 805 through 820 may be performed in any order or simultaneously without altering the 
process. The process then advances to step 835 where size is checked. This check basically 
ensures that the size of the translation unit is greater than or equal to the size of the wide 
operand, so that a physical address can directly replace the use of a virtual address. The concern 

10 is that, in some embodiments, the wide operands may be larger than the minimum region that the 
virtual memory system is capable of mapping. As a result, it would be possible for a single 
contiguous virtual address range to be mapped into multiple, disjoint physical address ranges, 
complicating the task of comparing physical addresses. By determining the size of the wide 
operand and comparing that size against the size of the virtual address mapping region which is 

15 referenced, the instruction is aborted with an exception trap if the wide operand is larger than the 
mapping region. This ensures secure operation of the processor. Software can then re-map the 
region using a larger size map to continue execution if desired. Thus, if size is reported as 
unacceptable at step 835, an exception is generated at step 840. If size is acceptable, the process 
advances to step 845 where physical address is checked. If the check reports as met, the process 

20 advances to step 850, where a check of the contents valid flag is made. If either check at step 
845 or 850 reports as false, the process branches and new content is written into the dedicated 
storage 1 14, with the fields thereof being set accordingly. Whether the check at step 850 
reported true, or whether new content was written at step 855, the process advances to step 860 
where appropriate fields are set to indicate the validity of the data, after which the requested 

25 function can be performed at step 825. The process then ends. 

[00125] Wide Microcache Control - Hardware 

[00126] Referring next to Figures 10 and 11, which together show the operation of the 
microcache controller from a hardware standpoint, the operation of the microcache controller 
30 may be better understood. In the hardware implementation, it is clear that conditions which are 
indicated as sequential steps in Figure 8 and 9 above can be performed in parallel, reducing the 
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delay for such wide operand checking. Further, a copy of the indicated hardware may be 
included for each wide microcache, and thereby all such microcaches as may be alternatively 
referenced by an instruction can be tested in parallel. It is believed that no further discussion of 
Figures 10 and 1 1 is required in view of the extensive discussion of Figures 8 and 9, above. 
5 [00127] Various alternatives to the foregoing approach do exist for the use of wide 
operands, including an implementation in which a single instruction can accept two wide 
operands, partition the operands into symbols, multiply corresponding symbols together, and add 
the products to produce a single scalar value or a vector of partitioned values of width of the 
register file, possibly after extraction of a portion of the sums. Such an instruction can be 

1 0 valuable for detection of motion or estimation of motion in video compression. A further 

enhancement of such an instruction can incrementally update the dedicated storage if the address 
of one wide operand is within the range of previously specified wide operands in the dedicated 
storage, by loading only the portion not already within the range and shifting the in-range portion 
as required. Such an enhancement allows the operation to be performed over a "sliding window" 

15 of possible values. In such an instruction, one wide operand is aligned and supplies the size and 
shape information, while the second wide operand, updated incrementally, is not aligned. 
[00128] The Wide Convolve Extract instruction and Wide Convolve Floating-point 
instruction described below is one alternative embodiment of an instruction that accepts two 
wide operands. 

20 [0100] Another alternative embodiment of the present invention can define additional 

instructions where the result operand is a wide operand. Such an enhancement removes the limit 
that a result can be no larger than the size of a general register, further enhancing performance. 
These wide results can be cached locally to the functional unit that created them, but must be 
copied to the general memory system before the storage can be reused and before the virtual 

25 memory system alters the mapping of the address of the wide result. Data paths must be added 
so that load operations and other wide operations can read these wide results - forwarding of a 
wide result from the output of a functional unit back to its input is relatively easy, but additional 
data paths may have to be introduced if it is desired to forward wide results back to other 
functional units as wide operands. 

30 [0101] As previously discussed, a specification of the size and shape of the memory 

operand is included with the low-order bits of the address. In a presently preferred 
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implementation, such memory operands are typically a power of two in size and aligned to that 
size. Generally, one half the total size is added (or inclusively or'ed, or exclusively or'ed) to the 
memory address, and one half of the data width is added (or inclusively or'ed, or exclusively 
or'ed) to the memory address. These bits can be decoded and stripped from the memory address, 
so that the controller is made to step through all the required addresses. The number of distinct 
operands required for these instructions is hereby decreased, as the size, shape and address of the 
memory operand are combined into a single register operand value. 

[01 02] In an alternative exemplary embodiment described below in the Wide Switch 

instruction and others below, the wide operand specifier is described as containing optional size 
and shape specifiers. As such, the omission of the specifier value obtains a default size or shape 
defined from attributes of the specified instruction. 

[01 03] In an alternative exemplary embodiment described below in the Wide Convolve 

Extract instruction below, the wide operand specifier contains mandatory size and shape 
specifier. The omission of the specifier value obtains an exception which aborts the operation. 
Notably, the specification of a larger size or shape than an implementation may permit due to 
limited resources, such as the limited size of a wide operand memory, may result in a similar 
exception when the size or shape descriptor is searched for only in the limited bit range in which 
a valid specifier value may be located. This can be utilized to ensure that software that requires a 
larger specifier value than the implementation can provide results in a detected exception 
condition, when for example, a plurality of implementations of the same instruction set of a 
processor differ in capabilities. This also allows for an upward-compatible extension of wide 
operand sizes and shapes to larger values in extended implementations of the same instruction 
set. 

[01 04] In an alternative exemplary embodiment, the wide operand specifier contains size 

and shape specifiers in an alternative representation other than linearly related to the value of the 
size.and shape parameters. For example, low-order bits of the specifier may contain a fixed-size 
binary value which is logarithmically related to the value, such as a two-bit field where 00 
conveys a value of 128, 01 a value of 256, 10 a value of 512, and 1 1 a value of 1024. The use of 
a fixed-size field limits the maximum value which can be specified in, for example, a later 
upward-compatible implementation of a processor. 
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pseudocode in the Figures referenced hereinafter: 
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x+y 


two's complement addition of x and y. Result is the same size as the operands, 
and operands must be of equal size. 


x-y 


two's complement subtraction of y from x. Result is the same size as the 
operands, and operands must be of equal size. 


x*y 


two's complement multiplication of x and y. Result is the same size as the 
operands, and operands must be of equal size. 


x/y 


two's complement division of x by y. Result is the same size as the operands, 
and operands must be of equal size. 


x&y 


bitwise and of x and y. Result is same size as the operands, and operands must 
be of equal size. 


x | y 


bitwise or of x and y. Result is same size as the operands, and operands must 
be of equal size. 


a 

x A y 


bitwise exclusive-of of x and y. Result is same size as the operands, and 
operands must be of equal size. 




bitwise inversion of x. Result is same size as the operand. 


x = y 


two's complement equality comparison between x and y. Result is a single bit, 
and operands must be of equal size. 




two's complement inequality comparison between x and y. Result is a single 
bit, and operands must be of equal size. 


X < V 


two's complement less than comnarison between x and v Result is a single bit 
and operands must be of equal size. 


X > V 


two's complement greater than or equal comparison between x and y. Result is 
a single bit, and operands must be of equal size. 




floating-point square root of x 




concatenation of bit field x to left of bit field y 




binary digit x repeated, concatenated y times. Size of result is y. 


x y 


extraction of bit y (using little-endian bit numbering) from value x. Result is a 
single bit. 
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extraction of bit field formed from bits y through z of value x. Size of result is - 
z+1; if z>y, result is an empty string, 


x !y:z 


value of y, if x is true, otherwise value of z. Value of x is a single bit. 


x <— y 


bitwise assignment 01 x to value ot y 


x.y 


subfield of structured bitfield x 


Sn 


signed, two's complement, binary data format of n bytes 


Un 


unsigned binary data format of n bytes 


Fn 


floating-point data format of n bytes 



[0106] Wide Operations 

[01 07] Particular examples of wide operations which are defined by the present invention 

include the Wide Switch instruction that performs bit-level switching; the Wide Translate 
5 instruction which performs byte (or larger) table lookup; Wide Multiply Matrix; Wide Multiply 
Matrix Extract and Wide Multiply Matrix Extract Immediate (discussed below), Wide Multiply 
Matrix Floating-point, and Wide Multiply Matrix Galois (also discussed below). While the 
discussion below focuses on particular sizes for the exemplary instructions, it will be appreciated 
that the invention is not limited to a particular width. 

10 

[0108] Wide Switch 

[0109] An exemplary embodiment of the Wide Switch instruction is shown in Figures 

12A-12D. In an exemplary embodiment, the Wide Switch instruction rearranges the contents of 
up to two registers (256 bits) at the bit level, producing a full-width (128 bits) register result. To 

15 control the rearrangement, a wide operand specified by a single register, consisting of eight bits 
per bit position is used. For each result bit position, eight wide operand bits for each bit position 
select which of the 256 possible source register bits to place in the result. When a wide operand 
size smaller than 128 bytes is specified, the high order bits of the memory operand are replaced 
with values corresponding to the result bit position, so that the memory operand specifies a bit 

20 selection within symbols of the operand size, performing the same operation on each symbol. 
[0110] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 
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placing the result in a general register. An exemplary embodiment of the format 1210 of the 
Wide Switch instruction is shown in Fig. 12 A. 

[0111] An exemplary embodiment of a schematic 1230 of the Wide Switch instruction is 

shown in Fig. 12B. In an exemplary embodiment, the contents of register rc specifies a virtual 
5 address apd optionally an operand size, and a value of specified size is loaded from memory. A 
second value is the catenated contents of registers rd and rb. Eight corresponding bits from the 
memory value are used to select a single result bit from the second value, for each corresponding 
bit position. The group of results is catenated and placed in register ra. 
[0112] In an exemplary embodiment, the virtual address must either be aligned to 128 

10 bytes, or must be the sum of an aligned address and one-half of the size of the memory operand 
in bytes. An aligned address must be an exact multiple of the size expressed in bytes. The size 
of the memory operand must be 8, 16, 32, 64, or 128 bytes. If the address is not valid an "access 
disallowed by virtual address" exception occurs. When a size smaller than 128 bits is specified, 
the high order bits of the memory operand are replaced with values corresponding to the bit 

1 5 position, so that the same memory operand specifies a bit selection within symbols of the 
operand size, and the same operation is performed on each symbol. 

[01 13] In an exemplary embodiment, a wide switch (W.SWITCH.L or W.SWITCH.B) 

instruction specifies an 8-bit location for each result bit from the memory operand, that selects 
one of the 256 bits represented by the catenated contents of registers rd and rb. 
20 [0114] An exemplary embodiment of the pseudocode 1250 of the Wide Switch 

instruction is shown in Fig. 12C. An exemplary embodiment of the exceptions 1280 of the Wide 
Switch instruction is shown in Fig. 12D. 

[0115] Wide Translate 

25 [0116] An exemplary embodiment of the Wide Translate instruction is shown in Figures 

13A-13D. In an exemplary embodiment, the Wide Translate instructions use a wide operand to 
specify a table of depth up to 256 entries and width of up to 128 bits. The contents of a register 
is partitioned into operands of one, two, four, or eight bytes, and the partitions are used to select 
values from the table in parallel. The depth and width of the table can be selected by specifying 

30 the size and shape of the wide operand as described above. 
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[01 17] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 
placing the result in a general register. An exemplary embodiment of the format 1310 of the 
5 Wide Translate instruction is shown in Fig. 13 A. 

[0118] An exemplary embodiment of the schematic 1330 of the Wide Translate 

instruction is shown in Fig. 13B. In an exemplary embodiment, the contents of register rc is used 
as a virtual address, and a value of specified size is loaded from memory. A second value is the 
contents of register rb. The values are partitioned into groups of operands of a size specified. 
10 The low-order bytes of the second group of values are used as addresses to choose entries from 
one or more tables constructed from the first value, producing a group of values. The group of 
results is catenated and placed in register rd. 

[01 19] In an exemplary embodiment, by default, the total width of tables is 128 bits, and 

a total table width of 128, 64, 32, 16 or 8 bits, but not less than the group size may be specified 

15 by adding the desired total table width in bytes to the specified address: 16, 8, 4, 2, or 1 . When 
fewer than 128 bits are specified, the tables repeat to fill the 128 bit width. 
[0120] In an exemplary embodiment, the default depth of each table is 256 entries, or in 

bytes is 32 times the group size in bits. An operation may specify 4, 8, 16, 32, 64, 128 or 256 
entry tables, by adding one half of the memory operand size to the address. Table index values 

20 are masked to ensure that only the specified portion of the table is used. Tables with just 2 
entries cannot be specified; if 2-entry tables are desired, it is recommended to load the entries 
into registers and use G.MUX to select the table entries. 

[0121] In an exemplary embodiment, failing to initialize the entire table is a potential 

security hole, as an instruction in with a small-depth table could access table entries previously 

25 initialized by an instruction with a large-depth table. This security hole may be closed either by 
initializing the entire table, even if extra cycles are required, or by masking the index bits so that 
only the initialized portion of the table is used. An exemplary embodiment may initialize the 
entire table with no penalty in cycles by writing to as many as 128 table entries at once. 
Initializing the entire table with writes to only one entry at a time requires writing 256 cycles, 

30 even when the table is smaller. Masking the index bits is the preferred solution. 
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[0122] In an exemplary embodiment, masking the index bits suggests that this 

instruction, for tables larger than 256 entries, may be extended to a general-purpose memory 
translate function where the processor performs enough independent load operations to fill the 
128 bits. Thus, the 16, 32, and 64 bit versions of this function perform equivalent of 8, 4, 2 
5 withdraw, 8, 4, or 2 load-indexed and 7, 3, or 1 group-extract instructions. In other words, this 
instruction can be as powerful as 23, 1 1, or 5 previously existing instructions. The 8-bit version 
is a single cycle operation replacing 47 existing instructions, so these extensions are not as 
powerful, but nonetheless, this is at least a 50% improvement on a 2-issue processor, even with 
one cycle per load timing. To make this possible, the default table size becomes 65536, 2 A 32 

10 and 2 A 64 for 16, 32 and 64-bit versions of the instruction. 

[0123] In an exemplary embodiment, for the big-endian version of this instruction, in the 

definition below, the contents of register rb is complemented. This reflects a desire to organize 
the table so that the lowest addressed table entries are selected when the index is zero. In the 
logical implementation, complementing the index can be avoided by loading the table memory 

15 differently for big-endian and little-endian versions; specifically by loading the table into 

memory so that the highest-addressed table entries are selected when the index is zero for a big- 
endian version of the instruction. In an exemplary embodiment of the logical implementation, 
complementing the index can be avoided by loading the table memory differently for big-endian 
and little-endian versions. In order to avoid complementing the index, the table memory is 

20 loaded differently for big-endian versions of the instruction by complementing the addresses at 
which table entries are written into the table for a big-endian version of the instruction. 
[0124] In an exemplary embodiment, the virtual address must either be aligned to 4096 

bytes, or must be the sum of an aligned address and one-half of the size of the memory operand 
in bytes and/or the desired total table width in bytes. An aligned address must be an exact 

25 multiple of the size expressed in bytes. The size of the memory operand must be a power of two 
from 4 to 4096 bytes, but must be at least 4 times the group size and 4 times the total table width. 
If the address is not valid an "access disallowed by virtual address" exception occurs, 
[0125] In an exemplary embodiment, a wide translate (W.TRANSLATE.8.L or 

W.TRANSLATE.8.B) instruction specifies a translation table of 16 entries (vsize=16) in depth, a 

30 group size of 1 byte (gsize=8 bits), and a width of 8 bytes (wsize=64 bits). The address specifies 
a total table size (msize=1024 bits=vsize*wsize) and a table width (wsize=64 bits) by adding one 
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half of the size in bytes of the table (64) and adding the size in bytes of the table width (8) to the 
table address in the address specification. The instruction will create duplicates of this table in 
the upper and lower 64 bits of the data path, so that 128 bits of operand are processed at once, 
yielding a 128 bit result. 
5 [0126] An exemplary embodiment of the pseudocode 1350 of the Wide Translate 

instruction is shown in Fig. 13C. An exemplary embodiment of the exceptions 1380 of the Wide 
Translate instruction is shown in Fig. 13D. 

[0127] Wide Multiply Matrix 

1 0 [0128] An exemplary embodiment of the Wide Multiply Matrix instruction is shown in 

Figures 14A-14E. In an exemplary embodiment, the Wide Multiply Matrix instructions use a 
wide operand to specify a matrix of values of width up to 64 bits (one half of register file and 
data path width) and depth of up to 128 bits/symbol size. The contents of a general register (128 
bits) is used as a source operand, partitioned into a vector of symbols, and multiplied with the 

1 5 matrix, producing a vector of width up to 128 bits of symbols of twice the size of the source 
operand symbols. The width and depth of the matrix can be selected by specifying the size and 
shape of the wide operand as described above. Controls within the instruction allow 
specification of signed, mixed signed, unsigned, complex, or polynomial operands. 
[0129] In an exemplary embodiment, these instructions take an address from a general 

20 register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 
placing the result in a general register. An exemplary embodiment of the format 1410 of the 
Wide Multiply Matrix instruction is shown in Fig. 14A. 

[0130] An exemplary embodiment of the schematics 1430 and 1460 of the Wide 

25 Multiply Matrix instruction is shown in Figs. 14B and 14C. In an exemplary embodiment, the 
contents of register rc is used as a virtual address, and a value of specified size is loaded from 
memory. A second value is the contents of register rb. The values are partitioned into groups of 
operands of the size specified. The second values are multiplied with the first values, then 
summed, producing a group of result values. The group of result values is catenated and placed 
30 in register rd. 
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[0131] In an exemplary embodiment, the memory multiply instructions (W.MUL.MAT, 

W.MUL.MAT.C, W.MUL.MAT.M, W.MUL.MAT.P, W.MUL.MAT.U) perform a partitioned 
array multiply of up to 8192 bits, that is 64x128 bits. The width of the array can be limited to 64, 
32, or 16 bits, but not smaller than twice the group size, by adding one half the desired size in 
5 bytes to the virtual address operand: 4, 2, or 1. The array can be limited vertically to 128, 64, 32, 
or 16 bits, but not smaller than twice the group size, by adding one-half the desired memory 
operand size in bytes to the virtual address operand. 

[0132] In an exemplary embodiment, the virtual address must either be aligned to 

1024/gsize bytes (or 512/gsize for W.MUL.MAT.C) (with gsize measured in bits), or must be the 
10 sum of an aligned address and one half of the size of the memory operand in bytes and/or one 

quarter of the size of the result in bytes. An aligned address must be an exact multiple of the size 
expressed in bytes. If the address is not valid an "access disallowed by virtual address" 
exception occurs. 

[0133] In an exemplary embodiment, a wide multiply octlets instruction 

15 (W.MUL.MAT.type.64, type=NONE M U P) is not implemented and causes a reserved 

instruction exception, as an ensemble-multiply-sum-octlets instruction (E.MUL.SUM.type.64) 
performs the same operation except that the multiplier is sourced from a 128-bit register rather 
than memory. Similarly, instead of wide-multiply-complex-quadlets instruction 
(W.MUL.MAT.C.32), one should use an ensemble-multiply-complex-quadlets instruction 
20 (E.MUL.SUM.C.32). 

[01 34] As shown in Fig. 14B, an exemplary embodiment of a wide-multiply-doublets 

instruction (W.MUL.MAT, W.MUL.MAT.M, W.MUL.MAT.P, W.MUL.MAT.U) multiplies 
memory [m31 m30 ... ml mO] with vector [h g f e d c b a], yielding products 
[hm31+gm27+...+bm7+am3 ... hm28+gm24+...+bm4+am0]. 
25 [0135] As shown in Fig. 14C, an exemplary embodiment of a wide-multiply-matrix- 

complex-doublets instruction (W.MUL.MAT.C) multiplies memory [ml5 ml4 ... ml mO] with 
vector [h g f e d c b a], yielding products [hml4+gml5+...+bm2+am3 ... 
hml2+gml3+...+bm0+aml hml3+gml2+... bml+amO]. 

[0136] An exemplary embodiment of the pseudocode 1480 of the Wide Multiply Matrix 

30 instruction is shown in Fig. 14D. An exemplary embodiment of the exceptions 1490 of the Wide 
Multiply Matrix instruction is shown in Fig. 14E. 
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[0137] Wide Multiply Matrix Extract 

[0138] An exemplary embodiment of the Wide Multiply Matrix Extract instruction is 

shown in Figures 15A-15F. In an exemplary embodiment, the Wide Multiply Matrix Extract 
5 instructions use a wide operand to specify a matrix of value of width up to 128 bits (full width of 
register file and data path) and depth of up to 128 bits/symbol size. The contents of a general 
register (128 bits) is used as a source operand, partitioned into a vector of symbols, and 
multiplied with the matrix, producing a vector of width up to 256 bits of symbols of twice the 
size of the source operand symbols plus additional bits to represent the sums of products without 

10 overflow. The results are then extracted in a manner described below (Enhanced Multiply 

Bandwidth by Result Extraction), as controlled by the contents of a general register specified by 
the instruction. The general register also specifies the format of the operands: signed, mixed- 
signed, unsigned, and complex as well as the size of the operands, byte (8 bit), doublet (16 bit), 
quadlet (32 bit), or hexlet (64 bit). 

15 [0139] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 
placing the result in a general register. An exemplary embodiment of the format 1510 of the 
Wide Multiply Matrix Extract instruction is shown in Fig. 15 A. 

20 [0140] An exemplary embodiment of the schematics 1530 and 1560 of the Wide 

Multiply Matrix Extract instruction is shown in Figs. 15C and 14D. In an exemplary 
embodiment, the contents of register rc is used as a virtual address, and a value of specified size 
is loaded from memory. A second value is the contents of register rd. The group size and other 
parameters are specified from the contents of register rb. The values are partitioned into groups 

25 of operands of the size specified and are multiplied and summed, producing a group of values. 
The group of values is rounded, and limited as specified, yielding a group of results which is the 
size specified. The group of results is catenated and placed in register ra. 
[0141] In an exemplary embodiment, the size of this operation is determined from the 

contents of register rb. The multiplier usage is constant, but the memory operand size is 

30 inversely related to the group size. Presumably this can be checked for cache validity. 
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[0142] In an exemplary embodiment, low order bits of re are used to designate a size, 

which must be consistent with the group size. Because the memory operand is cached, the size 
can also be cached, thus eliminating the time required to decode the size, whether from rb or 
from rc. 

5 [0143] In an exemplary embodiment, the wide multiply matrix extract instructions 

(W.MUL.MAT.X.B, W.MUL.MAT.X.L) perform a partitioned array multiply of up to 16384 
bits, that is 128x128 bits. The width of the array can be limited to 128, 64, 32, or 16 bits, but not 
smaller than twice the group size, by adding one half the desired size in bytes to the virtual 
address operand: 8, 4, 2, or 1. The array can be limited vertically to 128, 64, 32, or 16 bits, but 
10 not smaller than twice the group size, by adding one half the desired memory operand size in 
bytes to the virtual address operand. 

[0144] As shown in Fig. 1 5B, in an exemplary embodiment, bits 3 1 ..0 of the contents of 

register rb specifies several parameters which control the manner in which data is extracted. The 
position and default values of the control fields allow for the source position to be added to a 
15 fixed control value for dynamic computation, and allow for the lower 16 bits of the control field 
to be set for some of the simpler extract cases by a single GCOPYI instruction. 
[0145] In an exemplary embodiment, the table below describes the meaning of each 

label: 
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label 


bits 


meaning 


fsize 


8 


field size 


dpos 


8 


destination position 


X 


1 


reserved 


s 


1 


signed vs. unsigned 


n 


1 


complex vs. real multiplication 


m 




mixed-sign vs. same-sign multiplication 


1 




saturation vs. truncation 


md 


2 


rounding 


gssp 


9 


group size and source position 



[0146] In an exemplary embodiment, the 9 bit gssp field encodes both the group size, 

gsize, and source position, spos, according to the formula gssp = 512 4*gsize+spos. The group 
size, gsize, is a power of two in the range 1..128. The source position, spos, is in the range 
5 0..(2*gsize) 1. 

[0147] In an exemplary embodiment, the values in the s, n, m, t, and rnd fields have the 

following meaning: 



values 


s 


n 


m 


I 


rnd 


0 


unsigned 


real 


same-sign 


truncate 


F 


1 


signed 


complex 


mixed-sign 


saturate 


Z 


2 










N 


3 










C 



[0148] In an exemplary embodiment, the virtual address must be aligned, that is, it must 

10 be an exact multiple of the operand size expressed in bytes. If the address is not aligned an 
"access disallowed by virtual address" exception occurs. 

[0149] In an exemplary embodiment, Z (zero) rounding is not defined for unsigned 

extract operations, and a Reservedlnstruction exception is raised if attempted. F (floor) rounding 
will properly round unsigned results downward. 
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[0150] As shown in Fig. 15C, an exemplary embodiment of a wide-multiply-matrix- 

extract-doublets instruction (W.MUL.MAT.X.B or W.MUL.MAT.X.L) multiplies memory [m63 
m62 m61 ... ml ml mO] with vector [h g f e d c b a], yielding the products 
[0151] [am7+bml5+cm23+dm31 +em39+fm47+gm55+hm63 . ■ ■ 

5 [0152] am2+bm 1 0+cm 1 8+dm26+em34+fm42+gm50+hm5 8 

aml+bm9+cml7+dm25+em33+fm41+gm49+hm57 

am0+bm8+cml6+dm24+em32+fm40+gm48+hm56] ? rounded and limited as specified. 
[0153] As shown in Fig. 1 5D, an exemplary embodiment of a wide-multiply-matrix- 

extract-complex-doublets instruction (W.MUL.MAT.X with n set in rb) multiplies memory [m31 
10 m30 m29 ... m2 ml mO] with vector [h g f e d c b a], yielding the products 

[am7+bm6+cml5+dml4+em23+fin22+gm31+hm30 ... am2-bm3+cml0-dmll+eml8- 
fml9+gm26-hm27 aml+bm0+cm9+dm8+eml7+fml6+gm25+hm24 am0-bml+cm8- 
dm9+eml6-fl7+gm24 hm25], rounded and limited as specified. 

[0154] An exemplary embodiment of the pseudocode 1580 of the Wide Multiply Matrix 

15 Extract instruction is shown in Fig. 15E. An exemplary embodiment of the exceptions 1590 of 
the Wide Multiply Matrix Extract instruction is shown in Fig. 15F. 

[0155] Wide Multiply Matrix Extract Immediate 

[0156] An exemplary embodiment of the Wide Multiply Matrix Extract Immediate 

20 instruction is shown in Figures 16A-16E. In an exemplary embodiment, the Wide Multiply 
Matrix Extract Immediate instructions perform the same function as above, except that the 
extraction, operand format and size is controlled by fields in the instruction. This form encodes 
common forms of the above instruction without the need to initialize a register with the required 
control information. Controls within the instruction allow specification of signed, mixed signed, 
25 unsigned, and complex operands. 

[0157] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 
placing the result in a general register. An exemplary embodiment of the format 1610 of the 
30 Wide Multiply Matrix Extract Immediate instruction is shown in Fig. 16 A. 
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[0158] An exemplary embodiment of the schematics 1630 and 1660 of the Wide 

Multiply Matrix Extract Immediate instruction is shown in Figs. 16B and 16C. In an exemplary 
embodiment, the contents of register rc is used as a virtual address, and a value of specified size 
is loaded from memory. A second value is the contents of register rb. The values are partitioned 
5 into groups of operands of the size specified and are multiplied and summed in columns, 

producing a group of sums. The group of sums is rounded, limited, and extracted as specified, 
yielding a group of results, each of which is the size specified. The group of results is catenated 
and placed in register rd. All results are signed, N (nearest) rounding is used, and all results are 
limited to maximum representable signed values. 

10 [01 59] In an exemplary embodiment, the wide-multiply-extract-immediate-matrix 

instructions (W.MUL.MAT.X J, W.MUL.MAT.X.I.C) perform a partitioned array multiply of up 
to 16384 bits, that is 128x128 bits. The width of the array can be limited to 128, 64, 32, or 16 
bits, but not smaller than twice the group size, by adding one-half the desired size in bytes to the 
virtual address operand: 8, 4, 2, or 1. The array can be limited vertically to 128, 64, 32, or 16 

15 bits, but not smaller than twice the group size, by adding one half the desired memory operand 
size in bytes to the virtual address operand. 

[0160] In an exemplary embodiment, the virtual address must either be aligned to 

2048/gsize bytes (or 1024/gsize for W.MUL.MAT.X.I.C), or must be the sum of an aligned 
address and one-half of the size of the memory operand in bytes and/or one half of the size of the 

20 result in bytes. An aligned address must be an exact multiple of the size expressed in bytes. If 
the address is not valid an "access disallowed by virtual address" exception occurs. 
[0161] As shown in Fig. 16B, an exemplary embodiment of a wide-multiply-extract- 

immediate-matrix-doublets instruction (W.MUL.MAT.X.I.16) multiplies memory [m63 m62 
m61 ... m2 ml mO] with vector [h g f e d c b a], yielding the products 

25 [0162] [am7+bm 15+cm23+dm31+em39+fin47+gm55+hm63 . . . 

[01 63] am2+bml 0+cm 1 8+dm26+em34+fm42+gm50+hm58 

[0164] aml+bm9+cml7+dm25+em33+fm41+gm49+hm57 
am0+bm8+cml6+dm24+em32+fm40+gm48+hm56], rounded and limited as specified. 
[0165] As shown in Fig. 16C, an exemplary embodiment of a wide-multiply-matrix- 

30 extract-immediate-complex-doublets instruction (W.MUL.MAT.X.I.C. 1 6) multiplies memory 
[m31 m30 m29 ... m2 ml mO] with vector [h g f e d c b a], yielding the products 
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[am7+bm6+cml5+dml4+em23+fm22+gm31+hm30 ... am2-bm3+cml0-dmll+eml8- 
fml9+gm26-hm27 aml+bm0+cm9+dm8+eml7+fml6+gm25+hin24 am0-bml+cm8- 
dm9+eml6-fl7+gm24-hm25], rounded and limited as specified. 

5 [0166] An exemplary embodiment of the pseudocode 1680 of the Wide Multiply Matrix 

Extract Immediate instruction is shown in Fig. 16D. An exemplary embodiment of the 
exceptions 1590 of the Wide Multiply Matrix Extract Immediate instruction is shown in Fig. 
16E. 

10 [0167] Wide Multiply Matrix Floating-point 

[0168] An exemplary embodiment of the Wide Multiply Matrix Floating-point 

instruction is shown in Figures 17A-17E. In an exemplary embodiment, the Wide Multiply 
Matrix Floating-point instructions perform a matrix multiply in the same form as above, except 
that the multiplies and additions are performed in floating-point arithmetic. Sizes of half (16- 
15 bit), single (32-bit), double (64-bit), and complex sizes of half, single and double can be 
specified within the instruction. 

[0169] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, a second operand from a general register, perform 
a group of operations on partitions of bits in the operands, and catenate the results together, 

20 placing the result in a general register. An exemplary embodiment of the format 1710 of the 
Wide Multiply Matrix Floating point instruction is shown in Fig. 17A. 
[0170] An exemplary embodiment of the schematics 1730 and 1760 of the Wide 

Multiply Matrix Floating-point instruction is shown in Figs. 17B and 17C. In an exemplary 
embodiment, the contents of register rc is used as a virtual address, and a value of specified size 

25 is loaded from memory. A second value is the contents of register rb. The values are partitioned 
into groups of operands of the size specified. The second values are multiplied with the first 
values, then summed, producing a group of result values. The group of result values is catenated 
and placed in register rd. 

[0171] In an exemplary embodiment, the wide-multiply-matrix-floating-point 

30 instructions (W.MUL.MAT.F, W.MUL.MAT.C.F) perform a partitioned array multiply of up to 
16384 bits, that is 128x128 bits. The width of the array can be limited to 128, 64, 32 bits, but not 
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smaller than twice the group size, by adding one-half the desired size in bytes to the virtual 
address operand: 8, 4, or 2. The array can be limited vertically to 128, 64, 32, or 16 bits, but not 
smaller than twice the group size, by adding one-half the desired memory operand size in bytes 
to the virtual address operand. 
5 [0172] In an exemplary embodiment, the virtual address must either be aligned to 

2048/gsize bytes (or 1024/gsize for W.MUL.MAT.C.F), or must be the sum of an aligned 
address and one half of the size of the memory operand in bytes and/or one-half of the size of the 
result in bytes. An aligned address must be an exact multiple of the size expressed in bytes. If 
the address is not valid an "access disallowed by virtual address" exception occurs. 
10 [0173] As shown in Fig. 17B, an exemplary embodiment of a wide-multiply-matrix- 

floating-point-half instruction (W.MUL.MAT.F) multiplies memory [m31 m30 ... ml mO] with 
vector [h g f e d c b a], yielding products [hm31+gm27+...+bm7+am3 ... hm28+gm24+. . 
.+bm4+am0]. 

[01 74] As shown in Fig. 1 7C, an exemplary embodiment of a wide-multiply-matrix- 

15 complex-floating-point-half instruction (W.MUL.MAT.F) multiplies memory [ml5 ml4 ... ml 
mO] with vector [h g f e d c b a], yielding products [hml4+gml5+...+bm2+am3 ... 
hml2+gml3+...+bm0+aml -hml3+gml2+...-bml+am0]. 

[0175] An exemplary embodiment of the pseudocode 1780 of the Wide Multiply Matrix 

Floating-point instruction is shown in Fig. 17D. Additional pseudocode functions used by this 
20 and other floating point instructions is shown in Figure FLOAT- 1 . An exemplary embodiment 
of the exceptions 1790 of the Wide Multiply Matrix Floating-point instruction is shown in Fig. 
17E. 

[01 76] Wide Multiply Matrix Galois 

25 [01 77] An exemplary embodiment of the Wide Multiply Matrix Galois instruction is 

shown in Figures 18A-18D. In an exemplary embodiment, the Wide Multiply Matrix Galois 
instructions perform a matrix multiply in the same form as above, except that the multiples and 
additions are performed in Galois field arithmetic. A size of 8 bits can be specified within the 
instruction. The contents of a general register specify the polynomial with which to perform the 

30 Galois field remainder operation. The nature of the matrix multiplication is novel and described 
in detail below. 
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[0178] In an exemplary embodiment, these instructions take an address from a general 

register to fetch a large operand from memory, second and third operands from general registers, 
perform a group of operations on partitions of bits in the operands, and catenate the results 
together, placing the result in a general register. An exemplary embodiment of the format 1810 
5 of the Wide Multiply Matrix Galois instruction is shown in Fig. 18A. 

[0179] An exemplary embodiment of the schematic 1830 of the Wide Multiply Matrix 

Galois instruction is shown in Fig. 18B. In an exemplary embodiment, the contents of register re 
is used as a virtual address, and a value of specified size is loaded from memory. Second and 
third values are the contents of registers rd and rb. The values are partitioned into groups of 
10 operands of the size specified. The second values are multiplied as polynomials with the first 
value, producing a result which is reduced to the Galois field specified by the third value, 
producing a group of result values. The group of result values is catenated and placed in register 
ra. 

[01 80] In an exemplary embodiment, the wide-multiply-matrix-Galois-bytes instruction 

15 (W.MUL.MAT.G.8) performs a partitioned array multiply of up to 16384 bits, that is 128x128 
bits. The width of the array can be limited to 128, 64, 32, or 16 bits, but not smaller than twice 
the group size of 8 bits, by adding one-half the desired size in bytes to the virtual address 
operand: 8, 4, 2, or 1. The array can be limited vertically to 128, 64, 32, or 16 bits, but not 
smaller than twice the group size of 8 bits, by adding one-half the desired memory operand size 

20 in bytes to the virtual address operand. 

[0181] In an exemplary embodiment, the virtual address must either be aligned to 256 

bytes, or must be the sum of an aligned address and one-half of the size of the memory operand 
in bytes and/or one-half of the size of the result in bytes. An aligned address must be an exact 
multiple of the size expressed in bytes. If the address is not valid an "access disallowed by 

25 virtual address" exception occurs. 

[0182] As shown in Fig. 18B, an exemplary embodiment of a wide-multiply-matrix- 

Galois-byte instruction (W.MUL.MAT.G.8) multiplies memory [m255 m254 ... ml mO] with 
vector [ponmlkjihgfedcba], reducing the result modulo polynomial [q], yielding 
products [(pm255+om247+...+bm31+aml5 mod q) (pm254+om246+...+bm30+aml4 mod q) ... 

30 (pm248+om240-h..+bml6+am0 mod q)]. 
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[0183] An exemplary embodiment of the pseudocode 1 860 of the Wide Multiply Matrix 

Galois instruction is shown in Fig. 18C An exemplary embodiment of the exceptions 1890 of 
the Wide Multiply Matrix Galois instruction is shown in Fig. 18D. 

[0184] Memory Operands of Either Little-Endian or Big-Endian Conventional Byte 

5 Ordering 

[01 85] In another aspect of the invention, memory operands of either little-endian or big- 

endian conventional byte ordering are facilitated. Consequently, all Wide operand instructions 
are specified in two forms, one for little-endian byte ordering and one for big-endian byte 
ordering, as specified by a portion of the instruction. The byte order specifies to the memory 
10 system the order in which to deliver the bytes within units of the data path width (128 bits), as 
well as the order to place multiple memory words (128 bits) within a larger Wide operand. 

[0186] Extraction of a High Order Portion of a Multiplier Product or Sum of 

Products 

1 5 [0187] Another aspect of the present invention addresses extraction of a high order 

portion of a multiplier product or sum of products, as a way of efficiently utilizing a large 
multiplier array. Related U.S. Patent 5,742,840 and U.S. Patent 5,953,241 describe a system and 
method for enhancing the utilization of a multiplier array by adding specific classes of 
instructions to a general-purpose processor. This addresses the problem of making the most use 

20 of a large multiplier array that is fully used for high-precision arithmetic - for example a 64x64 
bit multiplier is fully used by a 64-bit by 64-bit multiply, but only one quarter used for a 32-bit 
by 32-bit multiply) for (relative to the multiplier data width and registers) low-precision 
arithmetic operations. In particular, operations that perform a great many low-precision 
multiplies which are combined (added) together in various ways are specified. One of the 

25 overriding considerations in selecting the set of operations is a limitation on the size of the result 
operand. In an exemplary embodiment, for example, this size might be limited to on the order of 
128 bits, or a single register, although no specific size limitation need exist. 
[0188] The size of a multiply result, a product, is generally the sum of the sizes of the 

operands, multiplicands and multiplier. Consequently, multiply instructions specify operations 

30 in which the size of the result is twice the size of identically-sized input operands. For our prior 
art design, for example, a multiply instruction accepted two 64-bit register sources and produces 
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a single 128-bit register-pair result, using an entire 64x64 multiplier array for 64-bit symbols, or 
half the multiplier array for pairs of 32-bit symbols, or one quarter the multiplier array for quads 
of 16-bit symbols. For all of these cases, note that two register sources of 64 bits are combined, 
yielding a 128-bit result. 

5 [01 89] In several of the operations, including complex multiplies, convolve, and matrix 

multiplication, low-precision multiplier products are added together. The additions further 
increase the required precision. The sum of two products requires one additional bit of precision; 
adding four products requires two, adding eight products requires three, adding sixteen products 
requires four. In some prior designs, some of this precision is lost, requiring scaling of the 

10 multiplier operands to avoid overflow, further reducing accuracy of the result. 

[0190] The use of register pairs creates an undesirable complexity, in that both the 

register pair and individual register values must be bypassed to subsequent instructions. As a 
result, with prior art techniques only half of the source operand 128-bit register values could be 
employed toward producing a single-register 128-bit result. 

15 [0191] In the present invention, a high-order portion of the multiplier product or sum of 

products is extracted, adjusted by a dynamic shift amount from a general register or an 
adjustment specified as part of the instruction, and rounded by a control value from a register or 
instruction portion as round-to-nearest/even, toward zero, floor, or ceiling. Overflows are 
handled by limiting the result to the largest and smallest values that can be accurately 

20 represented in the output result . 

[0192] Extract Controlled by a Register 

[01 93] In the present invention, when the extract is controlled by a register, the size of 

the result can be specified, allowing rounding and limiting to a smaller number of bits than can 
25 fit in the result. This permits the result to be scaled to be used in subsequent operations without 
concern of overflow or rounding, enhancing performance. 

[0194] Also in the present invention, when the extract is controlled by a register, a single 

register value defines the size of the operands, the shift amount and size of the result, and the 
rounding control. By placing all this control information in a single register, the size of the 
30 instruction is reduced over the number of bits that such a instruction would otherwise require, 
improving performance and enhancing flexibility of the processor. 
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[0195] The particular instructions included in this aspect of the present invention are 

Ensemble Convolve Extract, Ensemble Multiply Extract, Ensemble Multiply Add Extract and 
Ensemble Scale Add Extract. 

5 [0196] Ensemble Extract Inplace 

[0197] An exemplary embodiment of the Ensemble Extract Inplace instruction is shown 

in Figures 19A-19G. In an exemplary embodiment, several of these instructions (Ensemble 
Convolve Extract, Ensemble Multiply Add Extract) are typically available only in forms where 
the extract is specified as part of the instruction. An alternative embodiment can incorporate 

10 forms of the operations in which the size of the operand, the shift amount and the rounding can 
be controlled by the contents of a general register (as they are in the Ensemble Multiply Extract 
instruction). The definition of this kind of instruction for Ensemble Convolve Extract, and 
Ensemble Multiply Add Extract would require four source registers, which increases complexity 
by requiring additional general-register read ports. 

1 5 [01 98] In an exemplary embodiment, these operations take operands from four registers, 

perform operations on partitions of bits in the operands, and place the concatenated results in a 
fourth register. An exemplary embodiment of the format and operation codes 1910 of the 
Ensemble Extract Inplace instruction is shown in Fig. 19 A. 

[0199] An exemplary embodiment of the schematics 1930, 1945, 1960, and 1975 of the 

20 Ensemble Extract Inplace instruction is shown in Figs. 19C, 19D, 19E, and 19F. In an 

exemplary embodiment, the contents of registers rd, rc, rb, and ra are fetched. The specified 
operation is performed on these operands. The result is placed into register rd. 
[0200] In an exemplary embodiment, for the E.CON.X instruction, the contents of 

registers rd and rc are catenated, as c || d, and used as a first value. A second value is the contents 
25 of register rb. The values are partitioned into groups of operands of the size specified and are 
convolved, producing a group of values. The group of values is rounded, limited and extracted 
as specified, yielding a group of results that is the size specified. The group of results is 
catenated and placed in register rd. 

[0201] In an exemplary embodiment, for the E.MUL.ADD.X instruction, the contents of 

30 registers rc and rb are partitioned into groups of operands of the size specified and are multiplied, 
producing a group of values to which are added the partitioned and extended contents of register 
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rd. The group of values is rounded, limited and extracted as specified, yielding a group of results 
that is the size specified. The group of results is catenated and placed in register rd. 
[0202] As shown in Fig. 19B, in an exemplary embodiment, bits 31..0 of the contents of 

register ra specifies several parameters that control the manner in which data is extracted, and 

5 for certain operations, the manner in which the operation is performed. The position of the 
control fields allows for the source position to be added to a fixed control value for dynamic 
computation, and allows for the lower 16 bits of the control field to be set for some of the 
simpler extract cases by a single GCOPYL128 instruction. The control fields are further 
arranged so that if only the low order 8 bits are non-zero, a 128-bit extraction with truncation and 

10 no rounding is performed. 

[0203] In an exemplary embodiment, the table below describes the meaning of each 

label: 



label 


bits 


meaning 


fsize 


8 


field size 


dpos 


8 


destination position 


X 


1 


extended vs. group size result 


s 


1 


signed vs. unsigned 


n 


1 


complex vs. real multiplication 


m 


1 


mixed-sign vs. same-sign multiplication 


1 


1 


limit: saturation vs. truncation 


rnd 


2 


rounding 


gssp 


9 


group size and source position 



[0204] In an exemplary embodiment, the 9-bit gssp field encodes both the group size, 

15 gsize, and source position, spos, according to the formula gssp = 512-4*gsize+spos. The group 
size, gsize, is a power of two in the range 1..128. The source position, spos, is in the range 
0..(2*gsize)-l. 

[0205] In an exemplary embodiment, the values in the x, s, n, m, 1, and rnd fields have 

the following meaning: 



values 


X 


s 


n 


m 


1 


rnd 
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0 


group 


unsigned 


real 


same-sign 


truncate 


F 


1 


extended 


signed 


complex 


mixed-sign 


saturate 


Z 


2 












N 


3 












C 



[0206] Ensemble Multiply Add Extract 

[0207] As shown in Fig. 19C, an exemplary embodiment of an ensemble-multiply-add- 

extract-doublets instruction (E.MULADDX) multiplies vector rc [h g f e d c b a] with vector rb 
5 [p o n m 1 k j i], and adding vector rd [x w v u t s r q], yielding the result vector rd [hp+x go+w 
fh+v em-Hi dl+t ck+s bj+r ai+q], rounded and limited as specified by ra31..0. 
[0208] As shown in Fig. 19D, an exemplary embodiment of an ensemble-multiply-add- 

extract-doublets-complex instruction (E.MUL.X with n set) multiplies operand vector rc [h g f e 
d c b a] by operand vector rb [p o n m 1 k j i], yielding the result vector rd [gp+ho go-hp en+fm 

10 em-fh cl+dk ck-dl aj+bi ai-bj], rounded and limited as specified by ra31 ..0. Note that this 

instruction prefers an organization of complex numbers in which the real part is located to the 
right (lower precision) of the imaginary part. 

[0209] Ensemble Convolve Extract 

[0210] As shown in Fig. 19E, an exemplary embodiment of an ensemble-convolve- 

15 extract-doublets instruction (ECON.X with n=0) convolves vector rc||rd[xwvutsrqponm 
1 k j i] with vector rb [h g f e d c b a], yielding the products vector rd 
[02 1 1 ] [ax+b w+cv+du+et+fs+gr+hq . . . as+br+cq+dp+eo+fn+gm+hl 

[0212] ar+bq+cp+do+en+fm+gl+hk aq+bp+co+dn+em+fl+gk+hj], rounded and limited 

as specified by ra3i..o- 

20 [0213] As shown in Fig. 19F, an exemplary embodiment of an ensemble-convolve- 

extract-comp lex-doublets instruction (ECON.X with n=l) convolves vector rd || rc [x w v u t s r q 
p o n m 1 k j i] with vector rb [h g f e d c b a], yielding the products vector rd 
[02 1 4] [ax+b w+c v+du+et+fs+gr+hq . . . as-bt+cq-dr+eo-fp+gm-hn 

ar+bq+cp+do+en+fm+gl+hk aq-br+co-dp+em-fh+gk+hl], rounded and limited as specified by 

25 ra31..0. 
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[02 15] An exemplary embodiment of the pseudocode 1 990 of Ensemble Extract Inplace 

instruction is shown in Fig. 19G. In an exemplary embodiment, there are no exceptions for the 
Ensemble Extract Inplace instruction. 

5 [0216] Ensemble Extract 

[0217] An exemplary embodiment of the Ensemble Extract instruction is shown in 

Figures 20A-20J. In an exemplary embodiment, these operations take operands from three 
registers, perform operations on partitions of bits in the operands, and place the catenated results 
in a fourth register. An exemplary embodiment of the format and operation codes 2010 of the 

10 Ensemble Extract instruction is shown in Fig. 20A. 

[02 1 8] An exemplary embodiment of the schematics 2020, 2030, 2040, 2050, 2060, 

2070, and 2080 of the Ensemble Extract Inplace instruction is shown in Figs. 20C, 20D, 20E, 
20F, 20G, 20H, and 201. In an exemplary embodiment, the contents of registers rd, rc, and rb are 
fetched. The specified operation is performed on these operands. The result is placed into 

15 register ra. 

[0219] As shown in Fig. 20B, in an exemplary embodiment, bits 31 ..0 of the contents of 

register rb specifies several parameters that control the manner in which data is extracted, and for 
certain operations, the manner in which the operation is performed. The position of the control 
fields allows for the source position to be added to a fixed control value for dynamic 
20 computation, and allows for the lower 16 bits of the control field to be set for some of the 
simpler extract cases by a single GCOPYI.128 instruction. The control fields are further 
arranged so that if only the low order 8 bits are non-zero, a 128-bit extraction with truncation and 
no rounding is performed. 

[0220] In an exemplary embodiment, the table below describes the meaning of each 

25 label: 



label 


bits 


meaning 


fsize 


8 


field size 


dpos 


8 


destination position 


X 


1 


extended vs. group size result 


s 


1 


signed vs. unsigned 


n 


1 


complex vs. real multiplication 
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m 


1 


merge vs. extract or mixed-sign vs. 






same-sign multiplication 


1 


1 


limit: saturation vs. truncation 


rnd 


2 


rounding 


gssp 


9 


group size and source position 



[0221] In an exemplary embodiment, the 9-bit gssp field encodes both the group size, 

gsize, and source position, spos, according to the formula gssp = 512 4*gsize+spos. The group 
size, gsize, is a power of two in the range 1..128. The source position, spos, is in the range 
5 0..(2*gsize)-l. 

[0222] In an exemplary embodiment, the values in the x, s, n, m, 1, and rnd fields have 

the following meaning: 

10 



values 


X 


s 


n 


m 


1 


rnd 


0 


group 


unsigned 


real 


extract/same-sign 


truncate 


F 


1 


extended 


signed 


complex 


merge/mixed-sign 


saturate 


Z 


2 












N 


3 












C 



[0223] In an exemplary embodiment, for the E.SCAL.ADD.X instruction, bits 127..64 of 

the contents of register rb specifies the multipliers for the multiplicands in registers rd and rc. 
Specifically, bits 64+2*gsize-1..64+gsize is the multiplier for the contents of register rd, and bits 

1 5 64+gsize-l ..64 is the multiplier for the contents of register rc. 

[0224] Ensemble Multiply Extract 

[0225] As shown in Fig. 20C, an exemplary embodiment of an ensemble-multiply- 

extract-doublets instruction (E.MULX) multiplies vector rd [h g f e d c b a] with vector rc [p o n 
m 1 k j i], yielding the result vector ra [hp go fh em dl ck bj ai], rounded and limited as specified 

20 byrb 3 i.. 0 . 
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[0226] As shown in Fig. 20D, an exemplary embodiment of an ensemble-multiply- 

extract-doublets-complex instruction (E.MUL.X with n set) multiplies vector rd [h g f e d c b a] 
by vector rc [p o n m 1 k j i], yielding the result vector ra [gp+ho go-hp en+fm em-fh cl+dk ck-dl 
aj+bi ai-bj], rounded and limited as specified by rb 3 i.. 0 . Note that this instruction prefers an 
5 organization of complex numbers in which the real part is located to the right (lower precision) 
of the imaginary part. 

[0227] Ensemble Scale Add Extract 

[0228] An aspect of the present invention defines the Ensemble Scale Add Extract 

instruction, that combines the extract control information in a register along with two values that 

10 are used as scalar multipliers to the contents of two vector multiplicands. 

[0229] This combination reduces the number of registers that would otherwise be 

required, or the number of bits that the instruction would otherwise require, improving 
performance. Another advantage of the present invention is that the combined operation may be 
performed by an exemplary embodiment with sufficient internal precision on the summation 

1 5 node that no intermediate rounding or overflow occurs, improving the accuracy over prior art 
operation in which more than one instruction is required to perform this computation. 
[0230] As shown in Fig. 20E, an exemplary embodiment of an ensemble-scale-add- 

extract-doublets instruction (E.SCAL.ADD.X) multiplies vector rd [h g f e d c b a] with rb 9 5. 80 
[r] and adds the product to the product of vector rc [p o n m 1 k j i] with rb 79 ..64 [q], yielding the 

20 result [hr+pq gr+oq fr+nq er+mq dr+lq cr+kq br+jq ar+iq], rounded and limited as specified by 
rt>3i..o. 

[023 1 ] As shown in Fig. 20F, an exemplary embodiment of an ensemble-scale-add- 

extract-doublets-complex instruction (E.SCLADD.X with n set) multiplies vector rd [h g f e d c 
b a] with rbi27..96 [t s] and adds the product to the product of vector rc [p o n m 1 k j i] with rb 95 .64 
25 [r q], yielding the result [hs+gt+pq+or gs-ht+oq-pr fs+et+nq+mr es-ft+mq-nr ds+ct+lq+kr cs- 
dt+kq-lr bs+at+jq+ir as-bt+iq-jr], rounded and limited as specified by rb 3 i.. 0 . 

[0232] Ensemble Extract 

[0233] As shown in Fig. 20G, in an exemplary embodiment, for the E.EXTRACT 

30 instruction, when m=0 and x=0, the parameters specified by the contents of register rb are 
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interpreted to select fields from double size symbols of the catenated contents of registers rd and 
rc, extracting values which are catenated and placed in register ra. 

[0234] As shown in Fig. 20H, in an exemplary embodiment, for an ensemble-merge- 

extract (E.EXTRACT when m=l), the parameters specified by the contents of register rb are 
interpreted to merge fields from symbols of the contents of register rd with the contents of 
register rc. The results are catenated and placed in register ra. The x field has no effect when 
m=l. 

[0235] As shown in Fig. 201, in an exemplary embodiment, for an ensemble-expand- 

extract (E.EXTRACT when m=0 and x=l), the parameters specified by the contents of register 
rb are interpreted to extract fields from symbols of the contents of register rd. The results are 
catenated and placed in register ra. Note that the value of rc is not used. 
[0236] An exemplary embodiment of the pseudocode 2090 of Ensemble Extract 

instruction is shown in Fig. 20J. In an exemplary embodiment, there are no exceptions for the 
Ensemble Extract instruction. 

[0237] Reduction of Register Read Ports 

[0238] Another alternative embodiment can reduce the number of register read ports 

required for implementation of instructions in which the size, shift and rounding of operands is 
controlled by a register. The value of the extract control register can be fetched using an 
additional cycle on an initial execution and retained within or near the functional unit for 
subsequent executions, thus reducing the amount of hardware required for implementation with a 
small additional performance penalty. The value retained would be marked invalid, causing a re- 
fetch of the extract control register, by instructions that modify the register, or alternatively, the 
retained value can be updated by such an operation. A re-fetch of the extract control register 
would also be required if a different register number were specified on a subsequent execution. 
It should be clear that the properties of the above two alternative embodiments can be combined. 
[0239] Galois Field Arithmetic 

[0240] Another aspect of the invention includes Galois field arithmetic, where multiplies 

are performed by an initial binary polynomial multiplication (unsigned binary multiplication 
with carries suppressed), followed by a polynomial modulo/remainder operation (unsigned 
binary division with carries suppressed). The remainder operation is relatively expensive in area 
and delay. In Galois field arithmetic, additions are performed by binary addition with carries 
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suppressed, or equivalently, a bitwise exclusive or operation. In this aspect of the present 
invention, a matrix multiplication is performed using Galois field arithmetic, where the 
multiplies and additions are Galois field multiples and additions. 

[0241] Using prior art methods, a 16 byte vector multiplied by a 16x 16 byte matrix can 

5 be performed as 256 8-bit Galois field multiplies and 16* 15=240 8-bit Galois field additions. 
Included in the 256 Galois field multiplies are 256 polynomial multiplies and 256 polynomial 
remainder operations. 

[0242] By use of the present invention, the total computation is reduced significantly by 

performing 256 polynomial multiplies, 240 16-bit polynomial additions, and 16 polynomial 

1 0 remainder operations. Note that the cost of the polynomial additions has been doubled compared 
with the Galois field additions, as these are now 16-bit operations rather than 8-bit operations, 
but the cost of the polynomial remainder functions has been reduced by a factor of 16. Overall, 
this is a favorable tradeoff, as the cost of addition is much lower than the cost of remainder. 
[0243] Decoupled Access from Execution Pipelines and Simultaneous 

15 Multithreading 

[0244] In yet another aspect of the present invention, best shown in Figure 4, the present 

invention employs both decoupled access from execution pipelines and simultaneous 
multithreading in a unique way. Simultaneous Multithreaded pipelines have been employed in 
prior art to enhance the utilization of data path units by allowing instructions to be issued from 
20 one of several execution threads to each functional unit (e.g. Dean M. Tullsen, Susan J. Eggers, 
and Henry M. Levy, "Simultaneous Multithreading: Maximizing On Chip Parallelism," 
Proceedings of the 22nd Annual International Symposium on Computer Architecture, Santa 
Margherita Ligure, Italy, June, 1995). 

[0245] Decoupled access from execution pipelines have been employed in prior art to 

25 enhance the utilization of execution data path units by buffering results from an access unit, 
which computes addresses to a memory unit that in turn fetches the requested items from 
memory, and then presenting them to an execution unit (e.g. J. E. Smith, "Decoupled 
Access/Execute Computer Architectures", Proceedings of the Ninth Annual International 
Symposium on Computer Architecture, Austin, Texas (April 26 29, 1982), pp. 112-119). 
30 [0246] Compared to conventional pipelines, the Eggers prior art used an additional 

pipeline cycle before instructions could be issued to functional units, the additional cycle needed 



51 



Attorney Docket No.: 43876-144 



to determine which threads should be permitted to issue instructions. Consequently, relative to 
conventional pipelines, the prior art design had additional delay, including dependent branch 
delay. 

[0247] The present invention contains individual access data path units, with associated 

5 register files, for each execution thread. These access units produce addresses, which are 
aggregated together to a common memory unit, which fetches all the addresses and places the 
memory contents in one or more buffers. Instructions for execution units, which are shared to 
varying degrees among the threads are also buffered for later execution. The execution units 
then perform operations from all active threads using functional data path units that are shared. 
1 0 [0248] For instructions performed by the execution units, the extra cycle required for 

prior art simultaneous multithreading designs is overlapped with the memory data access time 
from prior art decoupled access from execution cycles, so that no additional delay is incurred by 
the execution functional units for scheduling resources. For instructions performed by the access 
units, by employing individual access units for each thread the additional cycle for scheduling 
1 5 shared resources is also eliminated. 

[0249] This is a favorable tradeoff because, while threads do not share the access 

functional units, these units are relatively small compared to the execution functional units, 
which are shared by threads. 

[0250] With regard to the sharing of execution units, the present invention employs 

20 several different classes of functional units for the execution unit, with varying cost, utilization, 
and performance. In particular, the G units, which perform simple addition and bitwise 
operations is relatively inexpensive (in area and power) compared to the other units, and its 
utilization is relatively high. Consequently, the design employs four such units, where each unit 
can be shared between two threads. The X unit, which performs a broad class of data switching 
25 functions is more expensive and less used, so two units are provided that are each shared among 
two threads. The T unit, which performs the Wide Translate instruction, is expensive and 
utilization is low, so the single unit is shared among all four threads. The E unit, which performs 
the class of Ensemble instructions, is very expensive in area and power compared to the other 
functional units, but utilization is relatively high, so we provide two such units, each unit shared 
30 by two threads. 
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[025 1] In Figure 4, four copies of an access unit are shown, each with an access 

instruction fetch queue A-Queue 401-404, coupled to an access register file AR 405-408, each of 
which is, in turn, coupled to two access functional units A 409-416. The access units function 
independently for four simultaneous threads of execution. These eight access functional units A 
5 409-416 produce results for access register files AR 405-408 and addresses to a shared memory 
system 417. The memory contents fetched from memory system 417 are combined with execute 
instructions not performed by the access unit and entered into the four execute instruction queues 
E-Queue 421-424. Instructions and memory data from E-queue 421-424 are presented to 
execution register files 425-428, which fetches execution register file source operands. The 

10 instructions are coupled to the execution unit arbitration unit Arbitration 43 1, that selects which 
instructions from the four threads are to be routed to the available execution units E 441 and 449, 
X 442 and 448, G 443-444 and 446-447, and T 445. The execution register file source operands 
ER 425-428 are coupled to the execution units 441-445 using source operand buses 451-454 and 
to the execution units 445-449 using source operand buses 455-458. The function unit result 

15 operands from execution units 441-445 are coupled to the execution register file using result bus 
461 and the function units result operands from execution units 445-449 are coupled to the 
execution register file using result bus 462. 

[0252] Improved Interprivilege Gateway 

20 [0253] In a still further aspect of the present invention, an improved interprivilege 

gateway is described which involves increased parallelism and leads to enhanced performance. 
In related U.S. Patent Application No. 08/541,416, a system and method is described for 
implementing an instruction that, in a controlled fashion, allows the transfer of control (branch) 
from a lower privilege level to a higher privilege level. The present invention is an improved 

25 system and method for a modified instruction that accomplishes the same purpose but with 
specific advantages. 

[0254] Many processor resources, such as control of the virtual memory system itself, 

input and output operations, and system control functions are protected from accidental or 
malicious misuse by enclosing them in a protective, privileged region. Entry to this region must 
30 be established only though particular entry points, called gateways, to maintain the integrity of 
these protected regions. 
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[0255] Prior art versions of this operation generally load an address from a region of 

memory using a protected virtual memory attribute that is only set for data regions that contain 
valid gateway entry points, then perform a branch to an address contained in the contents of 
memory. Basically, three steps were involved: load, then branch and check. Compared to other 
5 instructions, such as register to register computation instructions and memory loads and stores, 
and register based branches, this is a substantially longer operation, which introduces delays and 
complexity to a pipelined implementation. 

[0256] In the present invention, the branch-gateway instruction performs two operations 

in parallel: 1) a branch is performed to the Contents of register 0 and 2) a load is performed using 

10 the contents of register 1, using a specified byte order (little-endian) and a specified size (64 
bits). If the value loaded from memory does not equal the contents of register 0, the instruction 
is aborted due to an exception. In addition, 3) a return address (the next sequential instruction 
address following the branch-gateway instruction) is written into register 0, provided the 
instruction is not aborted. This approach essentially uses a first instruction to establish the 

15 requisite permission to allow user code to access privileged code, and then a second instruction is 
permitted to branch directly to the privileged code because of the permissions issued for the first 
instruction. 

[0257] In the present invention, the new privilege level is also contained in register 0, and 

the second parallel operation does not need to be performed if the new privilege level is not 

20 greater than the old privilege level. When this second operation is suppressed, the remainder of 
the instruction performs an identical function to a branch-link instruction, which is used for 
invoking procedures that do not require an increase in privilege. The advantage that this feature 
brings is that the branch-gateway instruction can be used to call a procedure that may or may not 
require an increase in privilege. 

25 [0258] The memory load operation verifies with the virtual memory system that the 

region that is loaded has been tagged as containing valid gateway data. A further advantage of 
the present invention is that the called procedure may rely on the fact that register 1 contains the 
address that the gateway data was loaded from, and can use the contents of register 1 to locate 
additional data or addresses that the procedure may require. Prior art versions of this instruction 

30 required that an additional address be loaded from the gateway region of memory in order to 
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initialize that address in a protected manner - the present invention allows the address itself to be 
loaded with a "normal" load operation that does not require special protection. 
[0259] The present invention allows a "normal" load operation to also load the contents 

of register 0 prior to issuing the branch-gateway instruction. The value may be loaded from the 
5 same memory address that is loaded by the branch-gateway instruction, because the present 
invention contains a virtual memory system in which the region may be enabled for normal load 
operations as well as the special "gateway" load operation performed by the branch-gateway 
instruction. 

[0260] Improved Interprivilege Gateway - System and Privileged Library Calls 

1 0 [026 1 ] An exemplary embodiment of the System and Privileged Library Calls is shown 

in Figures 21 A-21 B. An exemplary embodiment of the schematic 21 10 of System and 
Privileged Library Calls is shown in Fig. 21 A. In an exemplary embodiment, it is an objective to 
make calls to system facilities and privileged libraries as similar as possible to normal procedure 
calls as described above. Rather than invoke system calls as an exception, which involves 

15 significant latency and complication, a modified procedure call in which the process privilege 
level is quietly raised to the required level is used. To provide this mechanism safely, interaction 
with the virtual memory system is required. 

[0262] In an exemplary embodiment, such a procedure must not be entered from 

anywhere other than its legitimate entry point, to prohibit entering a procedure after the point at 

20 which security checks are performed or with invalid register contents, otherwise the access to a 
higher privilege level can lead to a security violation. In addition, the procedure generally must 
have access to memory data, for which addresses must be produced by the privileged code. To 
facilitate generating these addresses, the branch-gateway instruction allows the privileged code 
procedure to rely on the fact that a single register has been verified to contain a pointer to a valid 

25 memory region. 

[0263] In an exemplary embodiment, the branch-gateway instruction ensures both that 

the procedure is invoked at a proper entry point, and that other registers such as the data' pointer 
and stack pointer can be properly set. To ensure this, the branch-gateway instruction retrieves a 
"gateway" directly from the protected virtual memory space. The gateway contains the virtual 
30 address of the entry point of the procedure and the target privilege level. A gateway can only 
exist in regions of the virtual address space designated to contain them, and can only be used to 
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access privilege levels at or below the privilege level at which the memory region can be written 
to ensure that a gateway cannot be forged. 

[0264] In an exemplary embodiment, the branch-gateway instruction ensures that register 

1 (dp) contains a valid pointer to the gateway for this target code address by comparing the 
5 contents of register 0 (lp) against the gateway retrieved from memory and causing an exception 
trap if they do not match. By ensuring that register 1 points to the gateway, auxiliary 
information, such as the data pointer and stack pointer can be set by loading values located by 
the contents of register 1 . For example, the eight bytes following the gateway may be used as a 
pointer to a data region for the procedure. 

1 0 [0265] In an exemplary embodiment, before executing the branch-gateway instruction, 

register 1 must be set to point at the gateway, and register 0 must be set to the address of the 
target code address plus the desired privilege level. A "L.I.64.L.A r0=rl,0" instruction is one 
way to set register 0, if register 1 has already been set, but any means of getting the correct value 
into register 0 is permissible. 

15 [0266] In an exemplary embodiment, similarly, a return from a system or privileged 

routine involves a reduction of privilege. This need not be carefully controlled by architectural 
facilities, so a procedure may freely branch to a less-privileged code address. Normally, such a 
procedure restores the stack frame, then uses the branch-down instruction to return. 
[0267] An exemplary embodiment of the typical dynamic-linked, inter-gateway calling 

20 sequence 2130 is shown in Fig. 2 IB. In an exemplary embodiment, the calling sequence is 
identical to that of the inter-module calling sequence shown above, except for the use of the 
B.GATE instruction instead of a B.LINK instruction. Indeed, if a B.GATE instruction is used 
when the privilege level in the lp register is not higher than the current privilege level, the 
B.GATE instruction performs an identical function to a B.LINK. 

25 [0268] In an exemplary embodiment, the callee, if it uses a stack for local variable 

allocation, cannot necessarily trust the value of the sp passed to it, as it can be forged. Similarly, 
any pointers which the callee provides should not be used directly unless it they are verified to 
point to regions which the callee should be permitted to address. This can be avoided by 
defining application programming interfaces (APIs) in which all values are passed and returned 

30 in registers, or by using a trusted, intermediate privilege wrapper routine to pass and return 
parameters. The method described below can also be used. 
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[0269] In an exemplary embodiment, it can be useful to have highly privileged code call 

less-privileged routines. For example, a user may request that errors in a privileged routine be 
reported by invoking a user-supplied error-logging routine. To invoke the procedure, the 
privilege can be reduced via the branch-down instruction. The return from the procedure 
5 actually requires an increase in privilege, which must be carefully controlled. This is dealt with 
by placing the procedure call within a lower-privilege procedure wrapper, which uses the branch- 
gateway instruction to return to the higher privilege region after the call through a secure re-entry 
point. Special care must be taken to ensure that the less-privileged routine is not permitted to 
gain unauthorized access by corruption of the stack or saved registers, such as by saving all 

1 0 registers and setting up a new stack frame (or restoring the original lower-privilege stack) that 
may be manipulated by the less-privileged routine. Finally, such a technique is vulnerable to an 
unprivileged routine attempting to use the re-entry point directly, so it may be appropriate to 
keep a privileged state variable which controls permission to enter at the re-entry point. 
[0270] Improved Interprivilege Gateway - Branch Gateway 

1 5 [0271] An exemplary embodiment of the Branch Gateway instruction is shown in 

Figures 21C-21F. In an exemplary embodiment, this operation provides a secure means to call a 
procedure, including those at a higher privilege level. An exemplary embodiment of the format 
and operation codes 2160 of the Branch Gateway instruction is shown in Fig. 21C. 
[0272] An exemplary embodiment of the schematic 2170 of the Branch Gateway 

20 instruction is shown in Fig. 2 ID. In an exemplary embodiment, the contents of register rb is a 
branch address in the high-order 62 bits and a new privilege level in the low-order 2 bits. A 
branch and link occurs to the branch address, and the privilege level is raised to the new privilege 
level. The high-order 62 bits of the successor to the current program counter is catenated with 
the 2-bit current execution privilege and placed in register 0. 

25 [0273] In an exemplary embodiment, if the new privilege level is greater than the current 

privilege level, an octlet of memory data is fetched from the address specified by register 1, 
using the little-endian byte order and a gateway access type. A GatewayDisallowed exception 
occurs if the original contents of register 0 do not equal the memory data. 
[0274] In an exemplary embodiment, if the new privilege level is the same as the current 

30 privilege level, no checking of register 1 is performed. 
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[0275] In an exemplary embodiment, an AccessDisallowed exception occurs if the new 

privilege level is greater than the privilege level required to write the memory data, or if the old 
privilege level is lower than the privilege required to access the memory data as a gateway, or if 
the access is not aligned on an 8-byte boundary. 
5 [0276] In an exemplary embodiment, a Reservedlnstruction exception occurs if the rc 

field is not one or the rd field is not zero. 

[0277] In an exemplary embodiment, in the example in Fig. 21 D, a gateway from level 0 

to level 2 is illustrated. The gateway pointer, located by the contents of register rc (1), is fetched 
from memory and compared against the contents of register rb (0). The instruction may only 

10 complete if these values are equal. Concurrently, the contents of register rb (0) is placed in the 
program counter and privilege level, and the address of the next sequential address and privilege 
level is placed into register rd (0). Code at the target of the gateway locates the data pointer at an 
offset from the gateway pointer (register 1), and fetches it into register 1, making a data region 
available. A stack pointer may be saved and fetched using the data region, another region 

15 located from the data region, or a data region located as an offset from the original gateway 
pointer. 

[0278] In an exemplary embodiment, this instruction gives the target procedure the 

assurances that register 0 contains a valid return address and privilege level, that register 1 points 
to the gateway location, and that the gateway location is octlet aligned. Register 1 can then be 

20 used to securely reach values in memory. If no sharing of literal pools is desired, register 1 may 
be used as a literal pool pointer directly. If sharing of literal pools is desired, register 1 may be 
used with an appropriate offset to load a new literal pool pointer; for example, with a one cache 
line offset from the register 1. Note that because the virtual memory system operates with cache 
line granularity, that several gateway locations must be created together. 

25 [0279] In an exemplary embodiment, software must ensure that an attempt to use any 

octlet within the region designated by virtual memory as gateway either functions properly or 
causes a legitimate exception. For example, if the adjacent octlets contain pointers to literal pool 
locations, software should ensure that these literal pools are not executable, or that by virtue of 
being aligned addresses, cannot raise the execution privilege level. If register 1 is used directly 

30 as a literal pool location, software must ensure that the literal pool locations that are accessible as 
a gateway do not lead to a security violation. 
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[0280] In an exemplary embodiment, register 0 contains a valid return address and 

privilege level, the value is suitable for use directly in the Branch down (B.DOWN) instruction 
to return to the gateway callee. 

[028 1 ] An exemplary embodiment of the pseudocode 2 1 90 of the Branch Gateway 

instruction is shown in Fig. 2 IE. An exemplary embodiment of the exceptions 2199 of the 
Branch Gateway instruction is shown in Fig. 2 IF. 
[0282] Group Add 

[0283] In accordance with one embodiment of the invention, the processor handles a 

variety fix-point, or integer, group operations. For example, Fig. 26A presents various examples 
of Group Add instructions accommodating different operand sizes, such as a byte (8 bits), 
doublet (16 bits), quadlet (32 bits), octlet (64 bits), and hexlet (128 bits). Figs. 26B and 26C 
illustrate an exemplary embodiment of a format and operation codes that can be used to perform 
the various Group Add instructions shown in Fig. 26A. As shown in Figs. 26B and 26C, in this 
exemplary embodiment, the contents of registers rc and rb are partitioned into groups of 
operands of the size specified and added, and if specified, checked for overflow or limited, 
yielding a group of results, each of which is the size specified. The group of results is catenated 
and placed in register rd. While the use of two operand registers and a different result register is 
described here and elsewhere in the present specification, other arrangements, such as the use- of 
immediate values, may also be implemented. 

[0284] In the present embodiment, for example, if the operand size specified is a byte (8 

bits), and each register is 128-bit wide, then the content of each register may be partitioned into 
16 individual operands, and 16 different individual add operations may take place as the result of 
a single Group Add instruction. Other instructions involving groups of operands may perform 
group operations in a similar fashion. 

[0285] Group Set and Group Subtract 

[0286] Similarly, Fig. 27A presents various examples of Group Set instructions and 

Group Subtract instructions accommodating different operand sizes. Figs. 27B and 27C 
illustrate an exemplary embodiment of a format and operation codes that can be used to perform 
the various Group Set instructions and Group Subtract instructions. As shown in Figs. 27B and 
27C, in this exemplary embodiment, the contents of registers rc and rb are partitioned into 
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groups of operands of the size specified and for Group Set instructions are compared for a 
specified arithmetic condition or for Group Subtract instructions are subtracted, and if specified, 
checked for overflow or limited, yielding a group of results, each of which is the size specified. 
The group of results is catenated and placed in register rd. 

5 

[0287] Ensemble Convolve, Divide, Multiply, Multiply Sum 

[0288] In the present embodiment, other fix-point group operations are also available. 

Fig. 28 A presents various examples of Ensemble Convolve, Ensemble Divide, Ensemble 
Multiply, and Ensemble Multiply Sum instructions accommodating different operand sizes. 

10 Figs. 28B and 28C illustrate an exemplary embodiment of a format and operation codes that can 
be used to perform the various Ensemble Convolve, Ensemble Divide, Ensemble Multiply and 
Ensemble Multiply Sum instructions. As shown in Figs. 28B and 28C, in this exemplary 
embodiment, the contents of registers rc and rb are partitioned into groups of operands of the size 
specified and convolved or divided or multiplied, yielding a group of results, or multiplied and 

15 summed to a single result. The group of results is catenated and placed, or the single result is 
placed, in register rd. 

[0289] Ensemble Floating-Point Add, Divide, Multiply, and Subtract 

[0290] In accordance with one embodiment of the invention, the processor also handles a 

20 variety floating-point group operations accommodating different operand sizes. Here, the 
different operand sizes may represent floating point operands of different precisions, such as 
half-precision (16 bits), single-precision (32 bits), double-precision (64 bits), and quad-precision 

* 

(128 bits). Fig. 29 illustrates exemplary functions that are defined for use within the detailed 
instruction definitions in other sections and figures. In the functions set forth in Fig. 29, an 

25 internal format represents infinite-precision floating-point values as a four-element structure 
consisting of (1) s (sign bit): 0 for positive, 1 for negative, (2) t (type): NORM, ZERO, SNAN, 
QNAN, INFINITY, (3) e (exponent), and (4) f: (fraction). The mathematical interpretation of a 
normal value places the binary point at the units of the fraction, adjusted by the exponent: (- 
l)^s*(2 Ae )*f. The function F converts a packed IEEE floating-point value into internal format. 

30 The function PackF converts an internal format back into IEEE floating-point format, with 
rounding and exception control. 
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[029 1 f Figs. 3 OA and 3 1 A present various examples of Ensemble Floating Point Add, 

Divide, Multiply, and Subtract instructions. Figs. 30B-C and 31B-C illustrate an exemplary 
embodiment of formats and operation codes that can be used to perform the various Ensemble 
Floating Point Add, Divide, Multiply, and Subtract instructions. In these examples, Ensemble 
5 Floating Point Add, Divide, and Multiply instructions have been labeled as 

"EnsembleFloatingPoint." Also, Ensemble Floating-Point Subtract instructions have been 
labeled as "EnsembleReversedFloatingPoint." As shown in Figs. 30B-C and 31B-C, in this 
exemplary embodiment, the contents of registers rc and rb are partitioned into groups of 
operands of the size specified, and the specified group operation is performed, yielding a group 

10 of results. The group of results is catenated and placed in register rd. 

[0292] In the present embodiment, the operation is rounded using the specified rounding 

option or using round-to-nearest if not specified. If a rounding option is specified, the operation 
raises a floating-point exception if a floating-point invalid operation, divide by zero, overflow, or 
underflow occurs, or when specified, if the result is inexact. If a rounding option is not 

15 specified, floating-point exceptions are not raised, and are handled according to the default rules 
of IEEE 754. 

[0293] Ensemble Scale-Add Floating-point 

[0294] A novel instruction, Ensemble-Scale- Add improves processor performance by 

20 performing two sets of parallel multiplications and pairwise summing the products. This 

improves performance for operations in which two vectors must be scaled by two independent 
values and then summed, providing two advantages over nearest prior art operations of a fiised- 
multiply-add. To perform this operation using prior art instructions, two instructions would be 
needed, an ensemble-multiply for one vector and one scaling value, and an ensemble-multiply- 
25 add for the second vector and second scaling value, and these operations are clearly dependent. 
In contrast, the present invention fuses both the two multiplies and the addition for each 
corresponding elements of the vectors into a single operation. The first advantage achieved is 
improved performance, as in an exemplary embodiment the combined operation performs a 
greater number of multiplies in a single operation, thus improving utilization of the partitioned 
30 multiplier unit. The second advantage achieved is improved accuracy, as an exemplary 
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embodiment may compute the fused operation with sufficient intermediate precision so that no 
intermediate rounding the products is required. 

[0295] An exemplary embodiment of the Ensemble Scale- Add Floating-point instruction 

is shown in Figures 22A-22B. In an exemplary embodiment, these operations take three values 
5 from registers, perform a group of floating-point arithmetic operations on partitions of bits in the 
operands, and place the concatenated results in a register. An exemplary embodiment of the 
format 2210 of the Ensemble Scale-Add Floating-point instruction is shown in Fig. 22A. 
[0296] In an exemplary embodiment, the contents of registers rd and rc are taken to 

represent a group of floating-point operands. Operands from register rd are multiplied with a 

10 floating-point operand taken from the least-significant bits of the contents of register rb and 
added to operands from register rc multiplied with a floating-point operand taken from the next 
least-significant bits of the contents of register rb. The results are rounded to the nearest 
representable floating-point value in a single floating-point operation. Floating-point exceptions 
are not raised, and are handled according to the default rules of IEEE 754. The results are 

1 5 catenated and placed in register ra. 

[0297] An exemplary embodiment of the pseudocode 2230 of the Ensemble Scale-Add 

Floating-point instruction is shown in Fig. 22B. In an exemplary embodiment, there are no 
exceptions for the Ensemble Scale- Add Floating-point instruction. 

20 [0298] Performing a Three-Input Bitwise Boolean Operation in a Single Instruction 

(Group Boolean) 

[0299] In a further aspect of the present invention, a system and method is provided for 

performing a three-input bitwise Boolean operation in a single instruction. A novel method is 
used to encode the eight possible output states of such an operation into only seven bits, and 

25 decoding these seven bits back into the eight states. 

[0300] An exemplary embodiment of the Group Boolean instruction is shown in Figures 

23A-23C. In an exemplary embodiment, these operations take operands from three registers, 
perform boolean operations on corresponding bits in the operands, and place the concatenated 
results in the third register. An exemplary embodiment of the format 2310 of the Group Boolean 

30 instruction is shown in Fig. 23A. 
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[0301] An exemplary embodiment of a procedure 2320 of Group Boolean instruction is 

shown in Fig. 23B. In an exemplary embodiment, three values are taken from the contents of 
registers rd, rc and rb. The ih and il fields specify a function of three bits, producing a single bit 
result. The specified function is evaluated for each bit position, and the results are catenated and 
5 placed in register rd. In an exemplary embodiment, register rd is both a source and destination of 
this instruction. 

[0302] In an exemplary embodiment, the function is specified by eight bits, which give 

the result for each possible value of the three source bits in each bit position: 



d 


1 1 1 1 0 0 0 0 


c 


110 0 110 0 


b 


10 10 10 10 


f(d,cb) 


s,UUU f 3 f 2 f.fo 



1 0 [0303] In an exemplary embodiment, a function can be modified by rearranging the bits 

of the immediate value. The table below shows how rearrangement of immediate value f 7 ..o can 
reorder the operands d,c,b for the same function. 



operation 


immediate 


f(d,c,b) 


f 7 f 6 f 5 f4f 3 f 2 f 1 fo 


f(c,d,b) 


W3/2/ 5 /4flfo 


f(d,b,c) 


fifsf*Uhf\fi$> 


f(b,c,d) 


f7/ 3 f 5 /l/6f2/4f0 


f(c,b,d) 


fifsMfeAfzfo 


f(b,d,c) 


f7/ 3 /6/2/ 5 /l/4f0 



[0304] In an exemplary embodiment, by using such a rearrangement, an operation of the 

15 form: b=f(d,c,b) can be recoded into a legal form: b=f(b,d,c). For example, the function: 

b=f(d,c f b)=d?c:b cannot be coded, but the equivalent function: d=c?b:d can be determined by 
rearranging the code for d=f(d,c,b)=d?c: b, which is 1 1001010, according to the rule for 
f(d,c,b)=>f(c,b,d), to the code 11011000. 

20 [0305] Encoding 
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[0306] In an exemplary embodiment, some special characteristics of this rearrangement 

is the basis of the manner in which the eight function specification bits are compressed to seven 
immediate bits in this instruction. As seen in the table above, in the general case, a 
rearrangement of operands from f(d,c,b) to /(y,6,c/(interchanging rc and rb) requires 
5 interchanging the values of f 6 and f 5 and the values of f 2 and fi . 

[0307] In an exemplary embodiment, among the 256 possible functions which this 

instruction can perform, one quarter of them (64 functions) are unchanged by this rearrangement. 
These functions have the property that f6=fs and f2=f i . The values of rc and rb (Note that rc and 
rb are the register specifiers, not the register contents) can be freely interchanged, and so are 

10 sorted into rising or falling order to indicate the value of f 2 . (A special case arises when rc=rb, so 
the sorting of rc and rb cannot convey information. However, as only the values f 7 , U, f3, and f 0 
can ever result in this case, f$, f 2 , and fi need not be coded for this case, so no special handling 
is required.) These functions are encoded by the values of f 7 , f6, U> f3> and f 0 in the immediate 
field and f 2 by whether rc>rb, thus using 32 immediate values for 64 functions. 

15 [0308] In an exemplary embodiment, another quarter of the functions have f6=l and fs^O. 

These functions are recoded by interchanging rc and rb, f6 and fs, f 2 and ft. They then share the 
same encoding as the quarter of the functions where f6=0 and f 5 =l, and are encoded by the 
values of f 7 , f 4 > £3, f2, ft, and f 0 in the immediate field, thus using 64 immediate values for 128 
functions. 

20 [0309] In an exemplary embodiment, the remaining quarter of the functions have f6=f5 

and f 2 * fi. The half of these in which f 2 =l and f]=0 are recoded by interchanging rc and rb, f 6 
and f 5 , f 2 and ft. They then share the same encoding as the eighth of the functions where f 2 =0 
and ft=l, and are encoded by the values of f 7 , f6, £*> f3, and fo in the immediate field, thus using 
32 immediate values for 64 functions. 

25 [03 10] In an exemplary embodiment, the function encoding is summarized by the table: 
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1 


0 


1 


fl 


f 2 


f 7 


f 4 f 3 


fo trb trc 


[0311] 


In an exemplary embodiment, the function decoding is summarized by the table: 


ih il 5 


iU ib ih ili ilo rc>rb 
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f 5 
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f 3 


f 2 fi fo 


0 0 
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0 0 il 0 
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0 1 
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0 1 il 0 
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ils iU ilo 



5 [03 12] From the foregoing discussion, it can be appreciated that an exemplary 

embodiment of a compiler or assembler producing the encoded instruction performs the steps 
above to encode the instruction, comparing the f6 and f5 values and the f2 and fl values of the 
immediate field to determine which one of several means of encoding the immediate field is to 
be employed, and that the placement of the trb and trc register specifiers into the encoded 

10 instruction depends on the values of f2 (or fl) and f6 (or f5). 

[0313] An exemplary embodiment of the pseudocode 2330 of the Group Boolean 

instruction is shown in Fig. 23 C. It can be appreciated from the code that an exemplary 
embodiment of a circuit that decodes this instruction produces the f2 and fl values, when the 
immediate bits ih and il5 are zero, by an arithmetic comparison of the register specifiers rc and 

1 5 rb, producing a one (1) value for f2 and fl when rc>rb. In an exemplary embodiment, there are 
no exceptions for the Group Boolean instruction. 

[0314] Improving the Branch Prediction of Simple Repetitive Loops of Code 

[03 1 5] In yet a further aspect to the present invention, a system and method is described 

20 for improving the branch prediction of simple repetitive loops of code. In such a simple loop, 
the end of the loop is indicated by a conditional branch backward to the beginning of the loop. 
The condition branch of such a loop is taken for each iteration of the loop except the final 
iteration, when it is not taken. Prior art branch prediction systems have employed finite state 
machine operations to attempt to properly predict a majority of such conditional branches, but 
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without specific information as to the number of times the loop iterates, will make an error in 
prediction when the loop terminates. 

[0316] The system and method of the present invention includes providing a count field 

for indicating how many times a branch is likely to be taken before it is not taken, which 
5 enhances the ability to properly predict both the initial and final branches of simple loops when a 
compiler can determine the number of iterations that the loop will be performed. This improves 
performance by avoiding misprediction of the branch at the end of a loop when the loop 
terminates and instruction execution is to continue beyond the loop, as occurs in prior art branch 
prediction hardware. 

10 

[0317] Branch Hint 

[03 18] An exemplary embodiment of the Branch Hint instruction is shown in Figures 

24A-24C. In an exemplary embodiment, this operation indicates a future branch location 
specified by a register. 

15 [03 1 9] In an exemplary embodiment, this instruction directs the instruction fetch unit of 

the processor that a branch is likely to occur count times at simm instructions following the 
current successor instruction to the address specified by the contents of register rd. An 
exemplary embodiment of the format 2410 of the Branch Hint instruction is shown in Fig. 24 A. 
[0320] In an exemplary embodiment, after branching count times, the instruction fetch 

20 unit presumes that the branch at simm instructions following the current successor instruction is 
not likely to occur. If count is zero, this hint directs the instruction fetch unit that the branch is 
likely to occur more than 63 times. 

[0321] In an exemplary embodiment, an Access disallowed exception occurs if the 

contents of register rd is not aligned on a quadlet boundary. 
25 [0322] An exemplary embodiment of the pseudocode 2430 of the Branch Hint instruction 

is shown in Fig. 24B. An exemplary embodiment of the exceptions 2460 of the Branch Hint 
instruction is shown in Fig. 24C. 

[0323] Incorporating Floating Point Information into Processor Instructions 

30 [0324] In a still further aspect of the present invention, a technique is provided for 

incorporating floating point information into processor instructions. In related U.S. patent 
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581,2439, a system and method are described for incorporating control of rounding and 
exceptions for floating-point instructions into the instruction itself. The present invention 
extends this invention to include separate instructions in which rounding is specified, but default 
handling of exceptions is also specified, for a particular class of floating-point instructions. 

5 

[0325] Ensemble Sink Floating-point 

[0326] In an exemplary embodiment, a Ensemble Sink Floating-point instruction, which 

converts floating-point values to integral values, is available with control in the instruction that 
include all previously specified combinations (default-near rounding and default exceptions, Z - 

10 round-toward-zero and trap on exceptions, N - round to nearest and trap on exceptions, F - floor 
rounding (toward minus infinity) and trap on exceptions, C - ceiling rounding (toward plus 
infinity) and trap on exceptions, and X - trap on inexact and other exceptions), as well as three 
new combinations (Z.D - round toward zero and default exception handling, F.D - floor rounding 
and default exception handling, and CD - ceiling rounding and default exception handling). 

1 5 (The other combinations: N.D is equivalent to the default, and X.D - trap on inexact but default 
handling for other exceptions is possible but not particularly valuable). 
[0327] An exemplary embodiment of the Ensemble Sink Floating-point instruction is 

shown in Figures 25 A-25C. In an exemplary embodiment, these operations take one value from 
a register, perform a group of floating-point arithmetic conversions to integer on partitions of bits 

20 in the operands, and place the concatenated results in a register. An exemplary embodiment of 
the operation codes, selection, and format 2510 of Ensemble Sink Floating-point instruction is 
shown in Fig. 25 A. 

[0328] In an exemplary embodiment, the contents of register rc is partitioned into 

floating-point operands of the precision specified and converted to integer values. The results 

25 are catenated and placed in register rd. 

[0329] In an exemplary embodiment, the operation is rounded using the specified 

rounding option or using round-to- nearest if not specified. If a rounding option is specified, 
unless default exception handling is specified, the operation raises a floating-point exception if a 
floating-point invalid operation, divide by zero, overflow, or underflow occurs, or when 

30 specified, if the result is inexact. If a rounding option is not specified or if default exception 
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handling is specified, floating-point exceptions are not raised, and are handled according to the 
default rules of IEEE 754. 

[0330] An exemplary embodiment of the pseudocode 2530 of the Ensemble Sink 

Floating-point instruction is shown in Fig. 25B. An exemplary embodiment of the exceptions 
5 2560 of the Ensemble Sink Floating-point instruction is shown in Fig. 25C. 

[033 1] An exemplary embodiment of the pseudocode 2570 of the Floating-point 

instructions is shown in Fig. 25D. 

[0332] Crossbar Compress, Expand, Rotate, and Shift 

10 [0333] In one embodiment of the invention, crossbar switch units such as units 142 and 

148 perform data handling operations, as previously discussed. As shown in Fig. 32 A, such data 
handling operations may include various examples of Crossbar Compress, Crossbar Expand, 
Crossbar Rotate, and Crossbar Shift operations. Figs. 32B and 32C illustrate an exemplary 
embodiment of a format and operation codes that can be used to perform the various Crossbar 

15 Compress, Crossbar Rotate, Crossbar Expand, and Crossbar Shift instructions. As shown in 

Figs. 32B and 32C, in this exemplary embodiment, the contents of register rc are partitioned into 
groups of operands of the size specified, and compressed, expanded, rotated or shifted by an 
amount specified by a portion of the contents of register rb, yielding a group of results. The 
group of results is catenated and placed in register rd. 

20 [0334] Various Group Compress operations may convert groups of operands from higher 

precision data to lower precision data. An arbitrary half-sized sub-field of each bit field can be 
selected to appear in the result. For example, Fig. 32D shows an X.COMPRESS rd=rc,16,4 
operation, which performs a selection of bits 19..4 of each quadlet in a hexlet Various Group 
Shift operations may allow shifting of groups of operands by a specified number of bits, in a 

25 specified direction, such as shift right or shift left. As can be seen in Fig. 32C, certain Group 
Shift Left instructions may also involve clearing (to zero) empty low order bits associated with 
the shift, for each operand. Certain Group Shift Right instructions may involve clearing (to zero) 
empty high order bits associated with the shift, for each operand. Further, certain Group Shift 
Right instructions may involve filling empty high order bits associated with the shift with copies 

30 of the sign bit, for each operand. 
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[0335] Extract 

[0336] In one embodiment of the invention, data handling operations may also include a 

Crossbar Extract instruction. Figs. 33 A and 33B illustrate an exemplary embodiment of a format 
and operation codes that can be used to perform the Crossbar Extract instruction. As shown in 
5 Figs. 33A and 33B, in this exemplary embodiment, the contents of registers rd, rc, and rb are 
fetched. The specified operation is performed on these operands. The result is placed into 
register ra. 

[0337] The Crossbar Extract instruction allows bits to be extracted from different 

operands in various ways. Specifically, bits 31..0 of the contents of register rb specifies several 

10 parameters which control the manner in which data is extracted, and for certain operations, the 
manner in which the operation is performed. The position of the control fields allows for the 
source position to be added to a fixed control value for dynamic computation, and allows for the 
lower 16 bits of the control field to be set for some of the simpler extract cases by a single 
GCOPYI.128 instruction (see appendix). The control fields are further arranged so that if only 

1 5 the low order 8 bits are non-zero, a 128-bit extraction with truncation and no rounding is 
performed. 

31 24 23 16 15 14 13 12 11 10 9 8 0 



X 


s 


n 


m| 1 |rnd 



8 8 111112 9 

[0338] The table below describes the meaning of each label: 

20 



label 


bits 


meaning 


fsize 


8 


field size 


dpos 


8 


destination position 


X 


1 


reserved 


s 


1 


signed vs. unsigned I 


n 


1 


reserved 


m 


1 


merge vs. extract 


1 


1 


reserved 


rnd 


2 


reserved 


gssp 


9 


group size and source position 
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[0339] The 9-bit gssp field encodes both the group size, gsize, and source position, spos, 

according to the formula gssp - 512-4*gsize+spos. The group size, gsize, is a power of two in 
the range 1..128. The source position, spos, is in the range 0..(2*gsize)-L 
[0340] The values in the s, n, m, 1, and rnd fields have the following meaning: 

5 



values 


s 


n 


m 


1 


rnd 


0 


unsigned 




extract 






1 


signed 




merge 






2 












3 













[0341] As shown in Fig. 33C, for the X.EXTRACT instruction, when m=0, the 

parameters are interpreted to select a fields from the catenated contents of registers rd and rc, 
10 extracting values which are catenated and placed in register ra. As shown in Fig. 33D, for a 
crossbar-merge-extract (X.EXTRACT when m=l), the parameters are interpreted to merge a 
fields from the contents of register rd with the contents of register rc. The results are catenated 
and placed in register ra. 

15 [0342] Shuffle 

[0343] As shown in Fig. 34A, in one embodiment of the invention, data handling 

operations may also include various Shuffle instructions, which allow the contents of registers to 
be partitioned into groups of operands and interleaved in a variety of ways. Figs. 34B and 34C 
illustrate an exemplary embodiment of a format and operation codes that can be used to perform 
20 the various Shuffle instructions. As shown in Figs. 34B and 34C, in this exemplaiy embodiment, 
one of two operations is performed, depending on whether the rc and rb fields are equal. Also, 
Fig. 34B and the description below illustrate the format of and relationship of the rd, rc, rb, op, 
v, w, h, and size fields. 

[0344] In the present embodiment, if the rc and rb fields are equal, a 128-bit operand is 

25 taken from the contents of register rc. Items of size v are divided into w piles and shuffled 

together, within groups of size bits, according to the value of op. The result is placed in register 
rd. 
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[0345] Further, if the rc and rb fields are not equal, the contents of registers rc and rb 

are catenated into a 256-bit operand. Items of size v are divided into w piles and shuffled 
together, according to the value of op. Depending on the value of h, a sub-field of op, the low 
128 bits (h=0), or the high 128 bits (h=l) of the 256-bit shuffled contents are selected as the 
5 result. The result is placed in register rd. 

[0346] As shown in Fig. 34D, an example of a crossbar 4-way shuffle of bytes within 

hexlet instruction (X.SHUFFLE.128 rd=rcb,8,4) may divide the 128-bit operand into 16 bytes 
and partitions the bytes 4 ways (indicated by varying shade in the diagram below). The 4 
partitions are perfectly shuffled, producing a 128-bit result. As shown in Fig. 33E, an example 
10 of a crossbar 4-way shuffle of bytes within triclet instruction (X.SHUFFLE.256 rd=rc,rb,8,4,0) 
may catenate the contents of rc and rb, then divides the 256-bit content into 32 bytes and 
partitions the bytes 4 ways (indicated by varying shade in the diagram below). The low-order 
halves of the 4 partitions are perfectly shuffled, producing a 128-bit result. 
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[0347] Changing the last immediate value h to 1 (X.SHUFFLE.256 rd=rc,rb,8,4,l) may 

modify the operation to perform the same function on the high-order halves of the 4 partitions. 
When rc and rb are equal, the table below shows the value of the op field and associated values 
for size, v, and w. 





size 






op 

r 


V 


w 
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1 


2 


1 


8 
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2 
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8 


2 


2 
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4 


4 


16 
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2 
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16 


2 


2 
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16 


4 


2 
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16 


1 


4 


8 


16 


2 


4 


9 


16 


1 


8 


10 


32 
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11 


32 
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12 


32 
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13 


32 
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14 


32 
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4 


15 


32 
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16 


32 
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17 


32 
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18 


32 
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19 


32 
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16 


20 


64 
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2 


21 


64 
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22 


64 
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23 


64 


8 
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24 


64 


16 


2 


25 


64 
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26 


64 
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4 


27 


64 


4 


4 



op 

r 


size 


V 
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64 
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29 


64 
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8 


30 


64 
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8 ! 


31 


64 
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32 


64 


1 


16 


33 


64 
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16 


34 


64 
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32 


35 


128 
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36 


128 
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37 


128 
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38 


128 
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39 


128 


16 
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40 


128 


32 
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41 


128 
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128 
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43 


128 
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44 


128 
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45 


128 


16 
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46 


128 
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8 


47 


128 
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48 


128 
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49 


128 
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8 


50 


128 


1 


16 


51 


128 


2 


16 


52 


128 


4 


16 


53 


128 


1 


32 


54 


128 


2 


32 


55 


128 


1 


64 
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[0348] When rc and rb are not equal, the table below shows the value of the op4.,o field 

and associated values for size, v, and w: Ops is the value of h, which controls whether the low- 
order or high-order half of each partition is shuffled into the result. 



OVA 0 


size 
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256 
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J. 
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Z, 
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L. 


256 
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2 
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Zr J U 
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1 1 

1 I 


256 

Z, 


1 6 
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12 
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Z* JU 
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4 
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Z, JU 


Z. 
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1 5 
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Z, JVJ 
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256 
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256 


16 
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18 


256 
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16 


19 


256 
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16 


20 


256 
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16 


21 


256 


8 


16 


22 


256 
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32 


23 


256 
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32 


24 


256 
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32 


25 


256 
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64 


26 


256 
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64 


27 


256 


1 


128 



5 

[0349] Wide Solve Galois 

[0350] An exemplary embodiment of the Wide Solve Galois instruction is shown in 

Figures 35A-35B. Figure 35 A illustrates the present invention with a method and apparatus for 
solving equations iteratively. The particular operation described is a wide solver for the class of 
10 Galois polynomial congruence equations L*S = W (mod z**2T), where S, L, and W are 

polynomials in a galois field such as GF(256) of degree 2T, T+l, and T respectively. Solution of 
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this problem is a central computational step in certain error correction codes, such as Reed- 
Solomon codes, that optimally correct up to T errors in a block of symbols in order to render a 
digital communication or storage medium more reliable. Further details of the mathematics 
underpinning this implementation may be obtained from (Sarwate, Dilip V. and Shanbhag, 
5 Naresh R. "High-Speed Architectures for Reed-Solomon Decoders", revised June 7, 2000, 
Submitted to IEEE Trans. VLSI Systems, accessible from 

http://icims.csl.uiuc.edu/-shanbhag/vips/publications^ma.pdf and hereby incorporated by 
reference in its entirety.) 

[0351] The apparatus in Figure 35 A contains memory strips, Galois multipliers, Galois 

10 adders, muxes, and control circuits that are already contained in the exemplary embodiments 
referred to in the present invention. As can be appreciated from the description of the Wide 
Matrix Multiply Galois instruction, the polynomial remainder step traditionally associated with 
the Galois multiply can be moved to after the Galois add by replacing the remainder then add 
steps with a polynomial add then remainder step. 
1 5 [0352] This apparatus both reads and writes the embedded memory strips for multiple 

successive iterations steps, as specified by the iteration control block on the left. Each memory 
strip is initially loaded with polynomial S, and when 2T iterations are complete (in the example 
shown, T=4), the upper memory strip contains the desired solution polynomials L and W. The 
code block in Figure 35B describes details of the operation of the apparatus of Figure 3 5 A, using 
20 a C language notation. 

[0353] Similar code and apparatus can be developed for scalar multiply-add iterative 

equation solvers in other mathematical domains, such as integers and floating point numbers of 
various sizes, and for matrix operands of particular properties, such as positive definite matrices, 
or symetrix matrices, or upper or lower triangular matrices. 

25 

[0354] Wide Transform Slice 

[0355] An exemplary embodiment of the Wide Transform Slice instruction is shown in 

Figures 36A-36B. Figure 36A illustrates a method and apparatus for extremely fast computation 
of transforms, such as the Fourier Transform, which is needed for frequency-domain 
30 communications, image analysis, etc. In this apparatus, a 4 x 4 array of 16 complex multipliers 
is shown, each adjacent to a first wide operand cache. A second wide operand cache or 
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embedded coefficient memory array supplies operands that are multiplied by the multipliers with 
the data access from the wide embedded cache. The resulting products are supplied to strips of 
atomic transforms - in this preferred embodiment, radix-4 or radix-2 butterfly units. These units 
receive the products from a row or column of multipliers, and deposit results with specified 
5 stride and digit reversal back into the first wide operand cache. 

[0356] A general register ra contains both the address of the first wide operand as well as 

size and shape specifiers, and a second general register rb contains both the address of the second 
wide operand as well as size and shape specifiers. 

[0357] An additional general register rc specifies further parameters, such as precision, 

1 0 result extraction parameters (as in the various Extract instructions described in the present 
invention). 

[0358] In an alternative embodiment, the second memory operand may be located 

together with the first memory operand in an enlarged memory, using distinctive memory 
addressing to obtain either the first or second memory operand. 

1 5 [0359] In an alternative embodiment, the results are deposited into a third wide operand 

cache memory. This third memory operand may be combined with the first memory operand, 
again using distinctive memory addressing. By relabeling of wide operand cache tags, the third 
memory may alternate storage locations with the first memory. Thus upon completion of the 
Wide Transform Slice instruction, the wide operand cache tags are relabeled to that the result 

20 appears in the location specified for the first memory operand. This alternation allows for the 
specification of not-in-place transform steps and permits the operation to be aborted and 
subsequently restarted if required as the result of interruption of the flow of execution. 
[0360] The code block in Figure 36B describes the details of the operation of the 

apparatus of Figure 36 A, using a C language notation. Similar code and apparatus can be 

25 developed for other transforms and other mathematical domains, such as polynomial, Galois 
field, and integer and floating point real and complex numbers of various sizes. 
[0361] In an exemplary embodiment, the Wide Transform Slice instruction also 

computes the location of the most significant bit of all result elements, returning that value as a 
scalar result of the instruction to be placed in a general register rc. This is the same operand in 

30 which extraction control and other information is placed, but in an alternative embodiment, it 
could be a distinct register. Notably, this location of the most significant bit may be computed in 
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the exemplary embodiment by a series of Boolean operations on parallel subsets of the result 
elements yielding vector Boolean results, and at the conclusion of the operation, by reduction of 
the vector of Boolean results to a scalar Boolean value, followed by a determination of the most 
significant bit of the scalar Boolean value. 
5 [0362] By adding the values representing the extraction control and other information to 

this location of the most significant bit, an appropriate scaling parameter is obtained, for use in 
the subsequent stage of the Wide Transform Slice instruction. By accumulating the most 
significant bit information, an overall scaling value for the entire transform can be obtained, and 
the transformed results are maintained with additional precision over that of fixed scaling 
1 0 schemes in prior art. 



[0363] Wide Convolve Extract 

[0364] An exemplary embodiment of the Wide Convolve Extract instruction is shown in 

15 Figures 37A-37K. A similar method and apparatus can be applied to either digital filtering by 
methods of 1-D or 2-D convolution, or motion estimation by the method of 1-D or 2-D 
correlation. The same operation may be used for correlation, as correlation can be computed by 
reversing the order of the 1-D or 2-D pattern and performing a convolution. Thus, the 
convolution instruction described herein may be used for correlation, or a Wide Correlate Extract 

20 instruction can be constructed that is similar to the convolution instruction herein described 
except that the order of the coefficient operand block is 1-D or 2-D reversed. 
[0365] Digital filter coefficients or a estimation template block is stored in one wide 

operand memory, and the image data is stored in a second wide operand memory. A single row 
or column of image data can be shifted into the image array, with a corresponding shift of the 

25 relationship of the image data locations to the template block and multipliers. By this method of 
partially updating and moving the data in the second embedded memory, The correlation of 
template against image can be computed with greatly enhanced effective bandwidth to the 
multiplier array. Note that in the present embodiment, rather than shifting the array, circular 
addressing is employed, and a shift amount or start location is specified as a parameter of the 

30 instruction. 
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[0366] Figs 37A and 37B illustrate an exemplary embodiment of a format and operation 

codes that can be used to perform the Wide Convolve Extract instruction. As shown in Figs 37A 
and 37B, in this exemplary embodiment, the contents of general registers rc and rd are used as 
wide operand specifiers. These specifiers determine the virtual address, wide operand size and 
5 shape for wide operands. Using the virtual addresses and operand sizes, first and second values 
of specified size are loaded from memory. The group size and other parameters are specified 
from the contents of general register rb. The values are partitioned into groups of operands of the 
size and shape specified and are convolved, producing a group of values. The group of values is 
rounded, and limited as specified, yielding a group of results which is the size specified. The 

10 group of results is catenated and placed in general register ra. 

[0367] The wide-convolve-extract instructions (W.CONVOLVE.X.B, 

W.CONVOLVE.X.L) perform a partitioned array multiply of a maximum size limited only by 
the extent of the memory operands, not the size of the data path. The extent, size and shape 
parameters of the memory operands are always specified as powers of two; additional parameters 

1 5 may further limit the extent of valid operands within a power-of-two region. 

[0368] In an exemplary embodiment, as illustrated in Fig 37C, each of the wide operand 

specifiers specifies a memory operand extent by adding one-half the desired memory operand 
extent in bytes to the specifiers. Each of the wide operand specifiers specifies a memory operand 
shape by adding one- fourth the desired width in bytes to the specifiers. The heights of each of the 

20 memory operands can be inferred by dividing the operand extent by the operand width. One- 
dimensional vectors are represented as matrices with a height of one and with width equal to 
extent. In an alternative embodiment, some of the specifications herein may be included as part 
of the instruction. 

[0369] In an exemplary embodiment, the Wide Convolve Extract instruction allows bits 

25 to be extracted from the group of values computed in various ways. For example, bits 3 1 ..0 of 
the contents of general register rb specifies several parameters which control the manner in 
which data is extracted. The position and default values of the control fields allows for the source 
position to be added to a fixed control value for dynamic computation, and allows for the lower 
16 bits of the control field to be set for some of the simpler cases by a single GCOPYI 
30 instruction. In an alternative embodiment, some of the specifications herein may be included as 
part of the instruction. 
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31 



2423 



1615 14 13 12 11 109 8 



fsize 



dpos 



n ml 



l|rnd 



JgSS£_ 



11111 



[0370] 



The table below describes the meaning of each label: 



label 


bits 


meaning 


fsize 


8 


field size 


dpos 


8 


destination position 


X 


1 


extended vs. group size result 


s 


1 


signed vs. unsigned 


n 


1 


complex vs. real multiplication 


m 


1 


mixed-sign vs. same-sign 
multiplication 


1 


1 


saturation vs. truncation 


rnd 


2 


rounding 


gssp 


9 


group size and source position 



[0371] The 9-bit gssp field encodes both the group size, gsize, and source position, spos, 

according to the formula gssp - 512-4*gsize + spos. The group size, gsize, is a power of two in the 
range 1..128. The source position, spos, is in the range 0..(2*gsize)-l. 



[0372] The values in the x, s, n, m, 1, and rnd fields have the following meaning: 



values 


X 


s 


n 


m 


1 


rnd 


0 


group 


unsigned 


real 


same-sign 


truncate 


F 


1 


extended 


signed 


complex 


mixed-sign 


saturate 


Z 


2 












N 


3 












C 



[0373] Bits 9S..32 of the contents of general register rb specifies several parameters which 

control the selection of partitions of the memory operands. The position and default values of the 
control fields allows the multiplier zero length field to default to zero and the multiplicand origin 
position field computation to wrap around without overflowing into any other field by using 32-bit 
arithmetic. 



95 64 63 32 

mzero | mpos 

32 32 

[0374] The table below describes the meaning of each label: 
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label 


bits 


meaning 


mpos 


32 


multiplicand origin position 


mzero 


32 


multiplier zero length 



[0375] The 32-bit mpos field encodes both the horizontal and vertical location of the 

multiplicand origin, which is the location of the multiplicand element at which the zero-th element 
of the multiplier combines to produce the zero-th element of the result. Varying values in this field 
5 permit several results to be computed with no changes to the two wide operands. The mpos field is 
a byte offset from the beginning of the multiplicand operand. 

[0376] The 32-bit mzero field encodes a portion of the multiplier operand that has a zero 

value and which may be omitted from the multiply and sum computation. Implementations may use 
a non-zero value in this field to reduce the time and/ or power to perform the instruction, or may 

1 0 ignore the contents of this field. The implementation may presume a zero value for the multiplier 
operand in bits dmsize-l,.dmsize-(mzero*8), and skip the multiplication of any multiplier obtained 
from this bit range. The mzero field is a byte offset from the end of the multiplier operand. 
[0377] The virtual addresses of the wide operands must be aligned, that is, the byte 

addresses must be an exact multiple of the operand extent expressed in bytes. If the addresses are 

15 not aligned the virtual address cannot be encoded into a valid specifier. Some invalid specifiers cause 
an "Operand Boundary" exception. 

[0378] Z (zero) rounding is not defined for unsigned extract operations, so F (floor) 

rounding is substituted, which will properly round unsigned results downward. 
[0379] An implementation may limit the extent of operands due to limits on the operand 

20 memory or cache, or of the number of values that may be accurately summed, and thereby cause 
a Reservedlnstruction exception. 

[0380] As shown in Fig 37D and 37E, as an example with specific register values, a 

wide-convolve-extract-doublets instruction (W.CONVOLVE.X.B or W.CONVOLVE.X.L), with 
start in rb=24, convolves memory vector rc [c3 1 c30.. cl cO] with memory vector rd [dl 5 dl 4 . . . 

25 dl dO], yielding the products [cl6dl5+cl7dl4+. . .+c30dl+c31d0 

cl5dl5+cl6dl4+...+c29dl+c30d0 ... cl0dl5+clldl4+...+c24dl+c25d0 
c9dl5+cl0dl4+. . .+c23dl+c24d0], rounded and limited as specified by the contents of general 
register rb. The values c8. . .c0 are not used in the computation and may be any value. 
[0381] As shown in Fig 37F and 37G, as an example with specific register values, a 

30 wide-convolve-extract-doublets instruction (W.CONVOLVE.X.L), with mpos in rb=8 and 
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mzero in rb=48 (so length=(512-mzero)*dmsize/512=13), convolves memory vector rc [c31 

c30.. cl cO] with memory vector rd [dl5 dl4 . . . dl dO], yielding the products 

[c3dl2+c4dl 1+. . .+cl4dl+cl 5d0 c2dl2+c3dl 1+. . .+cl3dl+cl4d0 . . . 

c29dl2+c30dl 1+. . .+c8dl+c9d0 c28dl2+c29dl 1+. . .+c7dl+c8d0], rounded and limited as 
5 specified. In this case, the starting position is located so that the useful range of values wraps 

around below cO, to c31...28. The values c27...cl6 are not used in the computation and may be 

any value. The length parameter is set to 13, so values of dl5...dl3 must be zero. 

[0382] As shown in Fig 37H and 371, as an example with specific register values, a wide- 

convolve-extract-doublets-two-dimensional instruction (W.CONVOLVE.X.B or 
1 0 W.CONVOLVE.X.L), with mpos in rb=24 and vsize in rc and rd=4, convolves memory vector 

rc [c!27 cl26 ... c31 c30 ... cl cO] with memory vector rd [d63 d62 ... dl5 dl4 ... dl dO], 

yielding the products [cl 13d63+cl 12d62+. . .+cl6dl5+cl7dl4+. . .+c30dl+c31d0 

cl 12d63+cl 1 ld62+. . .+cl5dl5+cl6dl4+. . .+c29dl+c30d0 . . . 

cl07d63+cl06d62+...+cl0dl5+clldl4+...+c24dl+c25d0 
15 cl06d63+cl05d62+...+c9dl5+cl0dl4+...+c23dl+c24d0], rounded and limited as specified by 

the contents of general register rb, 

[0383] As shown in Fig 37J and 37K, as an example with specific register values, a wide- 

convolve-extract-complex-doublets instruction (W.CONVOLVE.X.B or W.CONVOLVE.X.L 
with n set in rb), with mpos in rb=12, convolves memory vector rc [cl5 cl4.. cl cO] with 
20 memory vector rd [d7 d6 . . , dl dO], yielding the products [c8d7+c9d6+. . .+cl6dl+cl5d0 

c7d7+c8d6+. . .+cl3dl+cl4d0 c6d7+c7d6+. . .+cl2dl+cl3d0 c5d7+c6d6+. . .+cl Idl+cl2d0], 
rounded and limited as specified by the contents of general register rb. 

[0384] Wide Convolve Floating-point 

25 [0385] A Wide Convolve Floating-point instruction operates similarly to the Wide 

Convolve Extract instruction described above, except that the multiplications and additions of 
the operands proceed using floating-point arithmetic. The representation of the multiplication 
products and intermediate sums in an exemplary embodiment are performed without rounding 
with essentially unbounded precision, with the final results subject to a single rounding to the 

30 precision of the result operand. In an alternative embodiment, the products and sums are 
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computed with extended, but limited precision. In another alternative embodiment, the products 
and sums are computed with precision limited to the size of the operands. 

The Wide Convolve Floating-point instruction in an exemplary embodiment may use the 
same format for the general register rb fields as the Wide Convolve Extract instruction, except 
5 for sfields which are not applicable to floating-point arithmetic. For example, the fsize, dpos, s, 
m, and 1 fields and the spos parameter of the gssp field may be ignored for this instruction. In an 
alternative embodiment, some of the remaining information may be specified within the 
instruction, such as the gsize parameter or the n parameter, or may be fixed to specified values, 
such as the rounding parameter may be fixed to round-to-nearest. In an alternative embodiment, 
10 the remaining fields may be rearranged, for example, if all but the mpos field are contained 
within the instruction or ignored, the mpos field alone may be contained in the least significant 
portion of the general register rb contents. 

[0386] Wide Decode 

1 5 [0387] Another category of enhanced wide operations is useful for error correction by 

means of Viterbi or turbo decoding. In this case, embedded memory strips are employed to 
contain state metrics and pre-traceback decision digits. An array of Add-Compare-Swap or log- 
MAP units receive a small number of branch metrics, such as 128 bits from an external register 
in our preferred embodiment. The array then reads, recomputes, and updates the state metric 

20 memory entries which for many practical codes are very much larger. A number of decision 

digits, typically 4-bits each with a radix- 16 pre-traceback method, is accumulated in a the second 
traceback memory. The array computations and state metric updates are performed iteratively 
for a specified number of cycles. A second iterative operation then traverses the traceback 
memory to resolve the most likely path through the state trellis. 

25 

[0388] Wide Boolean 

[0389] Another category of enhanced wide operations are Wide Boolean operations that 

involve an array of small look up tables (LUTs), typically with 8 or 16 entries each specified by 
3 or 4 bits of input address, interconnected with nearby multiplexors and latches. The control of 
30 the LUT entries, multiplexor selects, and latch clock enables is specified by an embedded wide 
cache memory. This structure provides a mean to provide a strip of field programmable gate 
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array that can perform iterative operations on operands provided from the registers of a general 
purpose microprocessor. These operations can iterate over multiple cycles, performing randomly 
specifiable logical operations that update both the internal latches and the memory strip itself. 

5 [0390] Transfers Between Wide Operand Memories 

[0391] The method and apparatus described here are widely applicable to the problem of 

increasing the effective bandwidth of microprocessor functional units to approximate what is 
achieved in application-specific integrated circuits (ASICs). When two or more functional units 
capable of handling wide operands are present at the same time, the problem arises of 

10 transferring data from one functional unit that is producing it into an embedded memory, and 
through or around the memory system, to a second functional unit also capable of handling wide 
operands that needs to consume that data after loading it into its wide operand memory. 
Explicitly copying the data from one memory location to another would accomplish such a 
transfer, but the overhead involved would reduce the effectiveness of the overall processor. 

15 [0392] Figure 38 describes a method and apparatus for solving this problem of transfer 

between two or more units with reduced overhead. The embedded memory arrays function as 
caches that retain local copies of data which is conceptually present in a single global memory 
space. A cache coherency controller monitors the address streams of cache activities, and 
employs one of the coherency protocols, such as MOESI or MESI, to maintain consistency up to 

20 a specified standard. By proper initialization of the cache coherency controller, software running 
on the general purpose microprocessor can enable the transfer of data between wide units to 
occur in background, overlapped with computation in the wide units, reducing the overhead of 
explicit loads and stores. 

25 [0393] Conclusion 

[0394] Having fully described a preferred embodiment of the invention and various 

alternatives, those skilled in the art will recognize, given the teachings herein, that numerous 
alternatives and equivalents exist which do not depart from the invention. It is therefore intended 
that the invention not be limited by the foregoing description, but only by the appended claims. 
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